IMPORTANT TECHNICAL NOTICE
Posted August 21st, 2016 by jared
For those who haven't noticed, Mintees.com (it's application and associated database) has fallen victim to a series of incredible remarkable technical issues beginning Friday night around midnight.
Long story long:
One of the primary servers on our network (one that houses Mintees and its database) experienced drive failure. This is not normally a big deal, the drives are set up in a RAID configuration to allow us to replace drives when necessary.
Once the drive was replaced, the data center did a file system check and discovered that the system was riddled with unrecoverable errors and we needed to do a restore from backup.
Normally this would not be that big of a deal, because our data center and server administrators have redundant back ups up to 7 days and then large chunks by week and even by month. Unfortunately, they discovered that every back up since January 5 has been corrupt and they never did anything about it or let us know.
Long story short, we went back in time to January 5, 2016.
We take this very seriously, this is a really big deal to us. In fact, there are a handful of other apps that power AKT that suffered from this and we are not looking forward to going back and repopulating missing data.
For the avoidance of doubt, the following are examples of what people shall be experiencing:
- No accounts created from January 5 forward currently exist
- Account settings you've changed since January are gone
- Tees, comments, posts, jobs, likes, approvals, denials after January 5 are gone
- Users who have had their profiles deleted after January 5 are back.
You get the idea.
---
While it is possible we may be able to recover something, the chances are slim to none. We've spent the entire weekend tirelessly night and day just to get things operable again.
On a personal note, in my ten years of running various applications across any number of server configurations, I have never experience such a string of bad luck and problems in one scenario by far. It is not a situation we will soon forget and surely one that will influence the future server configuration of Mintees.
We will update this thread if anything changes.
Thanks for your patience and understanding. We know this is a brutal situation to put our users through, but at this point we can only work with what's in front of us.
Jared, Cory & the entire AKT team
Long story long:
One of the primary servers on our network (one that houses Mintees and its database) experienced drive failure. This is not normally a big deal, the drives are set up in a RAID configuration to allow us to replace drives when necessary.
Once the drive was replaced, the data center did a file system check and discovered that the system was riddled with unrecoverable errors and we needed to do a restore from backup.
Normally this would not be that big of a deal, because our data center and server administrators have redundant back ups up to 7 days and then large chunks by week and even by month. Unfortunately, they discovered that every back up since January 5 has been corrupt and they never did anything about it or let us know.
Long story short, we went back in time to January 5, 2016.
We take this very seriously, this is a really big deal to us. In fact, there are a handful of other apps that power AKT that suffered from this and we are not looking forward to going back and repopulating missing data.
For the avoidance of doubt, the following are examples of what people shall be experiencing:
- No accounts created from January 5 forward currently exist
- Account settings you've changed since January are gone
- Tees, comments, posts, jobs, likes, approvals, denials after January 5 are gone
- Users who have had their profiles deleted after January 5 are back.
You get the idea.
---
While it is possible we may be able to recover something, the chances are slim to none. We've spent the entire weekend tirelessly night and day just to get things operable again.
On a personal note, in my ten years of running various applications across any number of server configurations, I have never experience such a string of bad luck and problems in one scenario by far. It is not a situation we will soon forget and surely one that will influence the future server configuration of Mintees.
We will update this thread if anything changes.
Thanks for your patience and understanding. We know this is a brutal situation to put our users through, but at this point we can only work with what's in front of us.
Jared, Cory & the entire AKT team

65 Comments
jared
said about 2
years ago
We know how much faith you put in us (Mintees.com) to store your artwork, thoughts, resources and profiles. We really let you down and sincerely apologize for it.
atomicchild said about 2 years ago
fuggart said about 2 years ago
joemaggots said about 2 years ago
dbdesign said about 2 years ago
Cameron Latham said about 2 years ago
jared
said about 2
years ago
Skull With Hair said about 2 years ago
Mgraphic said about 2 years ago
jared
said about 2
years ago
Go ahead and upload and re-promote it and I'll refund your money through paypal for this new transaction! giving you an extra two weeks (or whatever the timeline is)!
jared
said about 2
years ago
I keep trying to paypal you $0.00 but it won't let me.
miles to go said about 2 years ago
jared
said about 2
years ago
This site is not a money maker for us, never was. It pays for its hosting, sort of. It's more about keeping it around for the tens of thousands of visitors per month. The jobs section is really active and so many users love posting tees, I just can't justify taking it down because people don't comment as much.
This site affects the lives of more people than those who actively talk--at least that's what the numbers say, you know?
fuggart said about 2 years ago
I agree that even though the participation/conversation is in the dumps and no one at all <3s the designs any more it does still attract clients and business... I still upload knowing that it's being seen. that being said if it was costing me money personally I'd be pulling the plug in a heart beat
Cameron Latham said about 2 years ago
There's really no other place for people in our industry since BandJob called it quits. Dribbble is packed full of the people that take design way too seriously and is generally just kind of a circle jerk. Foalio was cool, but no one cared, so they pulled the plug. Behance... Well, I don't think anyone actually uses Behance?
Mintees is the last haven for music industry designers aside from a few Facebook groups scattered about, but they have the same circle jerk tendencies of Dribbble, so it's difficult to find any real value there.
But I do have to agree that if the site is only costing the owners money, then it'd be understandable if it were to be let go. Although I do now appreciate Mintees even more because of that fact.
atomicchild said about 2 years ago
I agree with everything Cameron said this is like a beacon for the Music t-shirt design world.
jared
said about 2
years ago
Done
atomicchild said about 2 years ago
nonzip said about 2 years ago
it make me With power In Drawing A lot
Please, I must the chance
Thanks man!
dobi said about 2 years ago
i gave you auto approval, but you have to promise me you will must the chance.
nonzip said about 2 years ago
Thanks dobi
Thank you very much for the chance
I promise!!!!!!!
BodilPunk said about 2 years ago
This is really, really bad news. 2 of my designs are 'tee of the month', and some of them are 'tee of the day'. Now all has gone. I think I deserve to get auto approval too.
bsteczdesigns said about 2 years ago
I've been voting every day as I can, but I agree the overall voting seems slow. I'm not sure if all the voters that were determined recently (I say recently but it may of been last year now?) have kept up with the site.
atomicchild said about 2 years ago
Mgraphic said about 2 years ago
yeah thanks bro that was awesome.. will re-upload it again soon,, thank you so much \m/
jared
said about 2
years ago
Cameron Latham said about 2 years ago
Yeah, same. Good call though.
Voting was relatively efficient pre-crash. I think we need more voters rather than new people on auto-approve. Some rando just uploaded nearly 30 designs and they could use a thumbs down.
EricAbstruse said about 2 years ago
fuggart said about 2 years ago
Cameron Latham said about 2 years ago
Definitely into this idea.
bsteczdesigns said about 2 years ago
Agreed as well
jared
said about 2
years ago
Bros...
Just hold Command + *click* when you vote something up or down. It opens the result in a new tab. (Control + *click* for windows weirdos).
jared
said about 2
years ago
THEGOODSHIT said about 2 years ago
Namsing said about 2 years ago
Agree !
xod03 said about 2 years ago
13UG-13th said about 2 years ago
zamboaga said about 2 years ago
Thank you for everything Mintees!
MrSnake said about 2 years ago
fuggart said about 2 years ago
Word... that worked great! much easier to keep up with voting now. Just a thought... donghan should be on auto approve now surely? dude produces solid stuff every time
http://www.mintees.com/people/208202-donghan/