Wow, I had no idea how entertaining a thread on the DB Purge and Summarize process could be until I jumped into this one!
Mark_Wonsil - I was thinking about getting that same Tattoo only across my forehead! LMBO!
aidacra - I canât stop clicking the magic eightball to see if it says anything different!
Not sure if this helps anyone but back in January, we performed a DB Purge and Summarize on all available Transactions/Options in our E9.05.702 Progress database. (We were also trying to clean up years of old, possibly bad/questionable data - due to some issues we had early on - and speed up our Migration to E10âŚ) Our company collectively made the decision to purge about 10 years worth of Transactions across the board. There was a LOT of testing of this process and its results ahead of time. Most of the testing was done in a VMWare TEST environment on our pretty beefy server but even with the PartTran fix it was taking an extremely long time to complete⌠Not sure that everyone has the money to put into something like a Falcon gaming machine but thatâs what we did and it was SOOO worth it! I wanted to cry when I saw how much faster the Purge Process was on this machine.
Just to give some idea (I collected the stats to help justify the purchase of the Falcon):
PartTran - 13954017 records - took over 2 days to complete on our VMServer versus 10.5 hours on the Falcon
Configuration Inputs - 8170073 records - 2 Hours on VMServer - 15 Minutes on Falcon
Change Log - 6294388 records - 3 Hours on VMServer - 24 Minutes on Falcon
For all other options the time was basically cut in halfâŚ
So for a 74GB Progress Database - Purging 10 years of Trans, for us, got us down to 30GB
(We did keep a copy of our Pre-Purged Database running on a VM in case anyone needed to access the âhistoricalâ data. Users have needed it at times but I hope we can eventually shut it down.)
Right after the Purge we performed a Dump and Load against the Database (the next weekend) which was obviously faster not only on the Falcon but also because we had less data to work with.
Our Progress to SQL Migration went from 53 hours to 14 hours on the Purged DB (and I havenât even tested it on the Falcon yet but Iâm getting ready to!).
So I guess all of this to say that the purge of that much data is do-able and can be a lot faster if you are on the âright versionâ, have the right fixes applied, and it REALLY helps to have the right hardware to run it onâŚand I would say, if you can, it is worth it to purchase a Purge/D&L/Migration/Conversion machine if you need to make things faster!
(Hope someone finds this data helpful! )
I feel like I need to add some sort of disclaimer on being very careful and running this in a test environment first and making sure that Purging is the right choice for you and your companyâŚyadda yadda yaddaâŚor something like that.