Jump to content







Photo

Fpn Database Restored After Crash


  • This topic is locked This topic is locked
158 replies to this topic

#1 Admin

Admin

    The FPN Admin Team

  • FPN Admin

  • PipPipPipPipPipPipPipPip
  • 934 posts

Posted 30 May 2011 - 10:34

Dearest members of the Board,

As you will likely have noticed, we were down for a few days.

On Friday, May 27, around 21:30 UTC / 22:30 BST / 18:30 EDT a database glitch resulted in us losing at a quick glance at least 800 - 900 member accounts, including a few moderator and admin accounts.

After trying to do a local restore for a few hours, we shut down FPN, first in order to try a partial and a complete database restore, and when that didn't work, we only had the option to do a full restore from the backup of Thursday, May 26, 17:00 EDT / 22:00 BST / 21:00 UTC, thereby losing some data, for approximately 1400 posts. This we considered to be a better option than losing at least 100,000+ posts from quite a few respected members here, including the loss of those members.

The full restore was finished at around 17:00 EDT / 22:00 BST / 21:00 UTC on Saturday, May 28. The site came online for a short time span, while we were checking initial data integrity. It appeared there were still some data problems, and as we didn't want to take any risks, we brought down the board again, and did a full integrity test of the entire database and board, with fixes as and where needed.

This required the rebuild of all posts, topics, member registrations, PMs, and a host of smaller items, and resulted amongst others automatically in the recount of posts. As we implemented the 30+/30+ rule on January 28, 2010, i.e., 30+ days of registration and 30+ posts in relevant forums (non-Chatter posts), and we hadn't done these integrity test for quite a few years, this rebuild resulted for post counts in the following:

1. All total post counts are likely down due to posting in spam topics and deleted double postings.
2. The main profile post count number lists the total remaining posts, including those in Chatter.
3. The mini profile panel next to each post only indicates all non-Chatter posts, IOW, only those that would count towards a Gold membership.

Because of the rules introduced early 2010, the number in the mini profile panel will likely differ significantly from the number in the full profile, for most members here. Nothing to worry about, however, and as integrity of the database is more important, in our consideration, than a mere number of posts next to one's member id, we considered this to be a minor evil. The recount was done automatically, with the rebuild of the posts, topics and forums, and this also took care of any old, dead links to no longer exisiting posts and topics (increasing integrity IOW).

All of the above was finished around 22:30 BST / 21:30 UTC / 17:30 EDT on Sunday, May 29, so we were effectively down for 2 entire days.

What did we lose because of this unavoidable exercise?

1. All replies, topics, comments, images and classifieds posted after the backup date and time, as mentioned, approximately 1400.
2. All new registrations after the backup date and time, approximately 60 new registrations
3. The automatic server startup procedure

1. and 2. is only something you all can fix, so please add the replies, topics, comments, images and classifieds again we lost, as well as you can, and for those who registered and whose registrations were undone due to the restore, please be so kind to reregister.
As to 3.: we are busy working on that right now. It may take some time to get this in order. Upon a glitch or upon a restart the server used to automatically start up any services it needed for FPN to work correctly, but this has reverted to beign a manual job. Until this is fixed, we may suffer from temporary outages occasionally - nothing to worry about, as nothing will get lost once "Added". It is just annoying. We will inform you when this is fixed again.

Update: Automatic startup procedure is fixed now too!

During the process of restoring and checking/fixing, we tried to keep you all up-to-date as much as possible through a "FPN maintenance" type temporary screen - we do hope this did help in mitigating, at least to some degree, any serious addiction withdrawal symptoms :D.

Warm regards,
The FPN Admin Team

Edited by wimg, 30 May 2011 - 14:22.
Added update for automatic startup fix

This account is unmanaged.
Please direct questions and comments to FPN Admin email, or directly to admin Wim (wimg).
 
Thank you very much in advance.
 
Warm regards,
The FPN Admin Team

#2 enricof

enricof

    Collectors Item

  • Member - Gold

  • PipPipPipPipPipPipPipPip
  • 1,448 posts
  • Location:Venice - Italy
  • Flag:

Posted 30 May 2011 - 11:35

I guess you had an hard weekend, didn't you?
No time for Montecarlo F1 race...


Thanks for your effort and welcome back, I was beginning to be seriously worried.

Ciao - Enrico
Diplomat #1961

Posted Image

Daddy, please no more pens - we need food, clothes, books, DENTISTRY...


#3 pmhudepo

pmhudepo

    Collectors Item

  • Member - Gold

  • PipPipPipPipPipPipPipPip
  • 1,445 posts

Posted 30 May 2011 - 11:42

Thanks for all your hard work. Much appreciated!

journaling / tinkering with pens / sailing / photography / software development


#4 Defacto

Defacto

    Vintage

  • Member - Gold

  • PipPipPipPipPipPipPip
  • 428 posts
  • Location:Barneveld, NL
  • Flag:

Posted 30 May 2011 - 11:50

Thank you very much for all your hard work. I started to get worried as well!
"I am what I am because of what I have been." (David McCallum)

Posted Image
Posted Image

#5 AlanE

AlanE

    Extremely Rare

  • Member - Gold

  • PipPipPipPipPipPip
  • 282 posts
  • Location:England
  • Flag:

Posted 30 May 2011 - 11:56

I was just about to book into rehab !!

Good job guys.

Alan

#6 diplomat

diplomat

    Platinum Member :)

  • Member - Gold

  • PipPipPipPipPipPipPipPipPipPip
  • 3,188 posts
  • Location:South EU

Posted 30 May 2011 - 11:56

Thank you, really. I work in IT and I know it's not easy when it happens.

#7 somnath1077

somnath1077

    Extremely Rare

  • Member - Gold

  • PipPipPipPipPipPip
  • 212 posts
  • Location:Aachen, Germany.
  • Flag:

Posted 30 May 2011 - 12:17

Thanks for all the work!

#8 sebas0902

sebas0902

    Mint

  • Member - Gold

  • PipPipPipPip
  • 50 posts
  • Location:Soria, Spain

Posted 30 May 2011 - 12:23

Thanks for all that great job

#9 Surfbits

Surfbits

    Extremely Rare

  • Member - Gold

  • PipPipPipPipPipPip
  • 276 posts
  • Location:Northern Wisconsin

Posted 30 May 2011 - 14:24

Didn't know how much I missed this forum until it was offline. Thank you for all you've done keeping this the place that it is, and working to make it better. Just so you know we do care.
Take care,
Tim Verpoorten (Surfbits)
http://www.surfbits.com : Blog
http://www.macreviewcast.com : Podcast

#10 mallymal1

mallymal1

    Antique

  • Member - Gold

  • PipPipPipPipPipPipPipPipPip
  • 1,637 posts
  • Location:UK
  • Flag:

Posted 30 May 2011 - 14:25

Good work...and many thanks. :thumbup:

#11 wimg

wimg

    Stip Etruria nut :)

  • FPN Admin

  • PipPipPipPipPipPipPipPipPipPipPipPipPip
  • 20,751 posts
  • Location:Maastricht, Netherlands, EU
  • Flag:

Posted 30 May 2011 - 14:26

Well, we are now finally in the clear, completely (knock wood :D).

Wamr regards, Wim

the Mad Dutchman
laugh a little, love a little, live a lot; laugh a lot, love a lot, live forever


#12 mitz009

mitz009

    Rare

  • Member - Gold

  • PipPipPipPipPip
  • 132 posts
  • Location:Tampa, Florida
  • Flag:

Posted 30 May 2011 - 14:38

Thanks to the administrators for all of the hard work and time you put in over the weekend. I certainly appreciate all of your efforts and found the maintenance screen to be highly effective in setting expectations, which is a huge factor in maintaining the board members' sanity.

#13 Alohamora

Alohamora

    Inkoholic

  • Member - Gold

  • PipPipPipPipPipPipPipPip
  • 848 posts
  • Location:USA
  • Flag:

Posted 30 May 2011 - 14:44

During the process of restoring and checking/fixing, we tried to keep you all up-to-date as much as possible through a "FPN maintenance" type temporary screen - we do hope this did help in mitigating, at least to some degree, any serious addiction withdrawal symptoms :D.

Warm regards,
The FPN Admin Team


Yes, those updates were very much appreciated! Good job getting things all squared away again.

#14 AVITWeb

AVITWeb

    Near Mint

  • Member - Gold

  • PipPipPip
  • 44 posts
  • Flag:

Posted 30 May 2011 - 14:46

+1....thanks for keeping it going guys (up just before the withdrawal....WHEW!) :)
I was just here....Where did I go?

#15 Lexaf

Lexaf

    Vintage

  • Member - Gold

  • PipPipPipPipPipPipPip
  • 661 posts
  • Location:Rijswijk, The Netherlands
  • Flag:

Posted 30 May 2011 - 14:54

Thanks for all your hard work. Much appreciated!


+1! Thanks!

#16 ArchiMark

ArchiMark

    Pen Nut & Pretty Good Guy

  • FPN Supporter - Platinum

  • PipPipPipPipPipPipPipPipPip
  • 2,215 posts
  • Location:California
  • Flag:

Posted 30 May 2011 - 14:55

Thanks for all your hard work on this, Wim....and thanks for updating the progress status periodically, that was very helpful and reassuring....

:thumbup:

All the best,

Mark
Digerati & FP Addict
Diplomat #055, Vacumaniac, & Nozacerati

*** Please check my for sale posts in Classifieds ***

#17 foxtail1

foxtail1

    Collectors Item

  • Member - Gold

  • PipPipPipPipPipPipPipPip
  • 1,044 posts
  • Location:SW Virginia, USA
  • Flag:

Posted 30 May 2011 - 15:01

Thanks for all you do, and I did especially appreciate the updates on the repair page as things progressed.

:notworthy1: :notworthy1:
Kristi

My photos on Flickr

Ask me about my purple pen addiction.

#18 The Good Captain

The Good Captain

    Gaston F Limoges

  • Member - Gold

  • PipPipPipPipPipPipPipPipPipPip
  • 4,923 posts
  • Location:Shropshire, Great Britain
  • Flag:

Posted 30 May 2011 - 15:11

Just to reiterate the other posts - THANKS!

The Good Captain
 
"Meddler's 'Salamander' - almost as good as the real thing!"
LetterExchange_sm.png


#19 Korybas

Korybas

    The pen is the tongue of the mind

  • Member - Gold

  • PipPipPipPipPipPipPip
  • 495 posts
  • Location:Athens, GREECE.
  • Flag:

Posted 30 May 2011 - 15:11

It was the longest weekend for me, without FPN to keep me company!
Thank you all for spending so much time to give us a haven from the chaotic outside world, which in its majority when it says"writing" it means "typing".... :gaah:

Edited by Korybas, 30 May 2011 - 15:26.

Posted Image

#20 Surf Monkey

Surf Monkey

    Rare

  • Member - Gold

  • PipPipPipPipPip
  • 163 posts
  • Location:Portland, Oregon
  • Flag:

Posted 30 May 2011 - 15:28

Excellent work. Kudos to the admin staff. I'm sure this is the last thing they wanted to be doing this weekend.