Taldren Forums
  Dynaverse II Experiences
  EAW Admins: Database Parser/Cleaner available for download

Post New Topic  Post A Reply
profile | register | preferences | faq | search

next newest topic | next oldest topic
Author Topic:   EAW Admins: Database Parser/Cleaner available for download
--BBJones--
Ensign

Posts: 1950
Registered: Jun 2001

posted 05-15-2002 11:26 PM     Click Here to See the Profile for --BBJones--   Click Here to Email --BBJones--     Edit/Delete Message   Reply w/Quote
Finally!

Took me forever to create an install package. I was running this forever straight out of the VB IDE!

Anyways...

Get the install here:
http://www.sfc2.net/downloads.asp

This program does 2 things:
1. Cleans database
- Removes all AI objects including their ships
- Removes all bad PreparedMissions objects
- Removes all news objects
- *** WARNING *** It will also remove all Auction objects (see useage notes below)

Usage:
- Install program
- Backup database to be cleaned
- Put in a keyfile to lockout players
- Run database long enough to clear out all auctions/bids (I set the turns to 30 sec/turn so this goes faster)
- Backup database again
- Run program
- Open database file (the one with NO bids)
- Clean database
- Copy down "objects removed" total when it's done
- Manually edit newly created database (called dbout.sds). You must deduct the "objects removed" count from the actual object count before starting the database again. The object count are bytes 5-8 staring from the beginning of the db (you will need a hex editor).
- Backup database
- Rename "dbout.sds" to the original name of your database
- Copy the now cleaned and renamed database back into production
- Remember to remove your keyfile and revert back any server settings before starting up again.

Did I mention you should backup your database?

Using this procedure, you can keep your database under 3MB till the end of time. You won't necessarily be able to have 100 players on, but with the 60 you do have the performance will stay good and the server will be much more stable.

2. Parser
This will allow you to parse your EAW database meaning you can extract player statistics.
Usage:
- Run the program on your database
- When it's done parsing, you can press the "Output to CSV" button.
- Now you can take this file and do whatever you want with the data.

I personally import the data into MS SQL Server so our web site can report the stats on a web page. This way we can also query the stats to do different things with them.

Check it out!
www.sfc2.net/tempstats/empiretotals.asp
www.sfc2.net/tempstats/players.asp

***** DISCLAIMER *******
This program sucks. Yup, it sucks bad. I wrote this in iddy bits of spare time and like I said only recently threw an installer at it. The code has gone through many iterations and evolved over the last 8 months or so, so it's a big mess, only half of it works, it looks like crap etc etc. BUT, it works. USE IT AT YOUR OWN RISK

I will post the source code soon as well so someone with some time can make it work right

Enjoy!

------------------
--BBJones--
SFC2.Net Administrator


SFC2.Net Homepage
admin@bozobits.com
Player Profile

[This message has been edited by --BBJones-- (edited 05-15-2002).]

IP: Logged

SCC Max Torps
Ensign

Posts: 1507
Registered: Jun 2001

posted 05-16-2002 02:24 AM     Click Here to See the Profile for SCC Max Torps   Click Here to Email SCC Max Torps     Edit/Delete Message   Reply w/Quote
Wow...
Thanks for releasing those tools! It will ceratinly help out a lot of admins and hopefully give the d2 a bit of a boost. Thanks!

------------------
POLL: WILL YOU BUY SFC3?

StarFleetComms - FREE email, websites, forums and a community D2 server.
Private Forum Access Requests
Starfleet Universe Forum
SFC2.net Forums
Pilot Profile
"History is the lie commonly agreed upon" - Voltaire.

IP: Logged

NannerSlug
Ensign

Posts: 3777
Registered: May 2000

posted 05-16-2002 07:21 AM     Click Here to See the Profile for NannerSlug   Click Here to Email NannerSlug     Edit/Delete Message   Reply w/Quote
this is huge!

thanks.

IP: Logged

Can-able
Ensign

Posts: 624
Registered: Mar 2001

posted 05-17-2002 01:47 AM     Click Here to See the Profile for Can-able   Click Here to Email Can-able     Edit/Delete Message   Reply w/Quote
It looks a nice little program....

Tryed it on a Op DB and it crashed i was curies.....

I hope you do relise the sourch code so that i can have a look and see what i could so with it

Thnaks for the tool.

IP: Logged

Gremlin
Ensign

Posts: 92
Registered: May 2002

posted 05-17-2002 06:47 AM     Click Here to See the Profile for Gremlin   Click Here to Email Gremlin     Edit/Delete Message   Reply w/Quote
If nothing else it shows the number of players on ATM nad all the accounts made for hte server. That by itself is usefull.

Any ideas on when the map and political option will function?

IP: Logged

--BBJones--
Ensign

Posts: 1950
Registered: Jun 2001

posted 05-17-2002 08:49 AM     Click Here to See the Profile for --BBJones--   Click Here to Email --BBJones--     Edit/Delete Message   Reply w/Quote
quote:
Originally posted by Gremlin:
If nothing else it shows the number of players on ATM nad all the accounts made for hte server. That by itself is usefull.

Any ideas on when the map and political option will function?


When someone else finishes it

The code currently parses those objects but doesn't record any of the info. Basically just skips them to get on to the rest.

Source code coming soon...

--BBJones--

IP: Logged

All times are PT(US)

next newest topic | next oldest topic

Administrative Options: Close Topic | Archive/Move | Delete Topic
Post New Topic  Post A Reply
Hop to:

Contact Us | Home


Ultimate Bulletin Board 5.47d


SFC II Maintenance Programming
by KhoroMag Gaming Services


   Hey! Anybody want a job?