And we're back!

A word from our sponsor:

Printer-friendly version

Author: 

Thanks to Piper's heroic efforts, BCTS is back online. We're getting so much traffic right now that things are acting a little quirky but it looks like that is clearing up as the buffers and caches fill up to take up the excess load. :)

Welcome back!

Hugs,
Erin, Piper, Cat, Jamie and Amy

Comments

Thank you so much.

To Piper and all those who worked so hard, thank you.

Please get some rest.

Gwen

Glad to see it up. I was

Glad to see it up. I was just checking once more before bed, and hit this at four seconds (according to the front page)

Hope to see a more technical workup for those in the field, but realize it's unlikely due to the audience :)

Guten Nacht.
BW


I'll get a life when it's proven and substantiated to be better than what I'm currently experiencing.

There are a few constants in this world……

D. Eden's picture

That mean more to me than I can describe. This site, all the friends I have made here over the years, and the support and kindness I have found here are one of those constants.

So glad to have everyone back. Thank you ladies for all of your efforts.

It means more than I can say.

D. Eden

Dum Vivimus, Vivamus

Great

That’s awesome.

hugs :)
Michelle SidheElf Amaianna

Welcome home

Lucy Perkins's picture

Goodness, it was absolutely wonderful to see the familiar pink logo this morning.
I guess you don't know what you've got till it's gone.
Thank you to the whole team for getting the site back.
Lucy xx

"Lately it occurs to me..
what a long strange trip its been."

Thanks Piper

Thanks for all your hard work Piper.

garfieldwritingsf.jpg
If there's a book that you want to read, but it hasn't been written yet, then you must write it.”
― Toni Morrison

Welcome back!

A huge bunch of virtual flowers to the whole team for your heroic efforts. Our prayers were finally answered. You all must have put in so many hours of stressful work getting the site back up, I salute you all!
Mammoth hugs, Bronwen Welsh

Thank you

Thank you for a superb (and no doubt frustrating) effort

Welcome back indeed!

It has seemed like the longest spell of drought that I can remember since I first registered with BCTS.
Now to restart catching up !
Dave

Glad

Maddy Bell's picture

to see you back

I'm sure it was a wirrying time for you guys too.

BC really is a cornerstone to some folks lives, your loss, even just for a couple of days, has big implications for their well being.

Mads


image7.1.jpg    

Madeline Anafrid Bell

Thank-you for your work

Happy to see you back. Thank-you for all your hard work putting things right.
Do you think someone or a group was trying to take you down? I think you have said before there had been attempts to attack BC.

Yes, Joni

. . .you don't know what you've got til it's gone.

Jill

Angela Rasch (Jill M I)

what happened

I appreciate all of your hard work of the entire team, well done. I really appreciated the messages sent through the Patreon system, it gave me hope for the site return.

I do have one question, why no current back? As a former computer technician I'm wondering how this calamity happened?

Huggles,

Winnie
Winnie_small.jpg

Personally, I'm assuming

Personally, I'm assuming there was a change of upstream IP provider, not just a moving of equipment to a new rack location. Until/Unless Piper chimes in, and I'm not expecting that for a day or two at best, we won't know for sure.


I'll get a life when it's proven and substantiated to be better than what I'm currently experiencing.

Not moving equipment from one

Piper's picture

Not moving equipment from one rack to another, moving the rack from the cage we were previously in, into the upstream's new suite. They upgraded from several disjointed cage spaces in multiple rooms, to a unified office/datacenter space within the colo facility, with their own glass-wall NOC and everything :) IT's really quite a nice setup.

But in the process, there was hardware that got jostled, raid cards that became unseated, filesystems that were corrupted and innodb tables that had severely crashed,

Once I got everything back up in a read-only state, I had to then dump the databases table by table because doing a massive dump of everything, or even of a single whole database, would cause segfaults, even with it slowed. But when dumping a table, I could let it go full speed. So I wrote some simple scripts to step through the databases and dump them table by table so that we could prevent rollback.


"She was like a butterfly, full of color and vibrancy when she chose to open her wings, yet hardly visible when she closed them."
— Geraldine Brooks


Eww. Been there, done

Eww. Been there, done similar.

Hope the hardware replacements weren't too expensive. segfaults are... problematic.


I'll get a life when it's proven and substantiated to be better than what I'm currently experiencing.

Backups, Rollback and Recovery

Piper's picture

Backups existed, butt rollback would have happened, and I wanted to prevent rollback. And while data recovery took a while, the database had been recovered for about 24hours before I was able to get the site back online due to issues that popped up as a result of the move.


"She was like a butterfly, full of color and vibrancy when she chose to open her wings, yet hardly visible when she closed them."
— Geraldine Brooks


Missed

I really missed the stories during your absence...

Thanks

RobertaME's picture

Losing this site for 2 days was hard.

Imagine losing it forever?

Now is the time to really show how grateful that this little corner of the internet is here... by giving to make sure it's still here next month.

Nothing worth having is free. Come on folks! Give whatever you can! If we all gave a few bucks, it would amount to thousands.

Thanks to Erin, Piper, and the rest of the BCTS team for making sure we still have our home away from home.

Hugs,
Roberta

<3

Thanks for being understanding. Piper, the ninja and I are all sick. Piper seems to be suffering the worst out of all of us with the ninja not far behind. She's really been working hard not only fixing the site while taking care of the ninja and I and being understanding that it's crunch time for me during the semester. She also took a trip to the data center shortly after helping out a friend of ours with a ride to and from same day surgery at 4 am on Monday
Although I may be a bit biased, I happen to think she's pretty amazing. Keep her in your thoughts. She doesn't get sick often, but when she does it takes more out of her than she will admit.
Babe , thanks for taking care of us. Love you to the backend of forever and always in all ways,
Amy