Our DB is now a Furth of what it used to be?

ChgLog and PatchFld are 2 other tables that are similar, Patchfld is a
temporary table that is used during conversions, and change log is just your
change log, if you keep a backup of the DB pre- D&L you can always go back
and reference it, but I have found that most customers don't ever actually
reference the change log, even though they want it "just in case".

Periodically flushing the ChgLog, even through a Progress code, is perfectly
fine since it is not linked through with any kind of business logic to any
other tables. Keep a backup for long term if you want, or you can always do
a dump of it to a .d(text) file if you want to save it in another way, worst
case you could load it back into a test database to reference it.

Although, in reality, since it does require DB writes, I think most
companies need to re-think how much they really need to log in their change
log, far too many log far too much.

-----Original Message-----
From: vantage@yahoogroups.com [mailto:vantage@yahoogroups.com] On Behalf Of
Mike Anstey
Sent: Monday, January 23, 2012 9:15 AM
To: vantage@yahoogroups.com
Subject: RE: [Vantage] Our DB is now a Furth of what it used to be??????

Also did you check your ABTWork file? This has a bunch of temporary
transactions that are used in financial transactions. There is a purge
program that came out in 905.606, but I'm not sure what it does as it still
leave a few hundred records in the file after it is done. ( I had
40,000 + records that were deleted when the program ran).



From: vantage@yahoogroups.com [mailto:vantage@yahoogroups.com] On Behalf Of
Jose Gomez
Sent: Monday, January 23, 2012 10:05 AM
To: Vantage
Subject: [Vantage] Our DB is now a Furth of what it used to be??????





Hi All,

This is the story of my weekend, but before I go any further I'd like to put
here a GIANT disclaimer, I DO NOT recommend you do this and if you do it and
your stuff BREAKS I am NOT responsible, I am simply sharing my experience.

We are getting ready to do the move to 9.05 from 9.04 and before I do the
big move I wanted to do a D&L (Dump and Load) to defrag the DB (we are
progress). Our DB was 15GB and it was running DOG slow. On Friday I spent
the major part of the day getting ready, set up the files and folder and at
5 O'clock sharp I started the Dump.

A few minutes later the dump of the schema was done and I moved on to the
dump of the data, I was expecting this to take "HOURS UPON HOURS" as many
had warned, so I let it be and came back to it 4 hours later. The process
was done.

I started the schema load and let it run for about 1 hour and then once the
process was complete I was ready to start the data Load. I went to the dump
folder and out curiosity I sorted the Files by size, I wanted to see which
one of my "MASSIVE" tables was the biggest, lo and be hold once I did the
sort by size I was surprised to see a 6GB table, it was called
"sysactivitylog" with a name like that it obviously called my attention and
I started poking around, it turns out its a transaction log table that you
can enable in your company configuration under System -> General Settings,
this table logs EVERYTHING that happens in your system and thus it grows and
grows and grows.

On that same article in Epic Web it mentioned that 9.05 has a purge program
that can be run to empty this DB, obviously I am not on 9.05 yet so I
decided to take a risk, during the Data Load part of the D&L I removed the
sysactivitylog from the load folder and let the load process. After a few
hours the process was done and the only error was "Couldn't Find
sysactivitylog", I ran a records count on all the tables before and after
and everything matched (Except the sysactivitylog)

I restored the DB into Test and it worked like a charm, the DB went from
15GB to 3 GB after D&L (small enough to shove most of it in ram), we are
running the production system on this today, and I keep waiting for the
other shoe to drop, but at the moment everything seems to be running
smoothly and our DB is WAYYYY smaller now. After the DB came back up, I went
into Company Config and disabled System Activity Tracking to prevent this
table from becoming huge again.

Again I am NOT recommending you do this, I am simply sharing my experience,
if you have any thoughts or experience with this I would love to hear it

Thanks!

*Jose C Gomez*
*Software Engineer*
*
*
*checkout my new blog <http://www.usdoingstuff.com> *
*
*T: 904.469.1524 mobile
E: jose@... <mailto:jose%40josecgomez.com>
http://www.josecgomez.com <http://www.linkedin.com/in/josecgomez>
<http://www.facebook.com/josegomez>
<http://www.google.com/profiles/jose.gomez>
<http://www.twitter.com/joc85>
<http://www.josecgomez.com/professional-resume/>
<http://www.josecgomez.com/feed/>
<http://www.usdoingstuff.com>

*Quis custodiet ipsos custodes?*

[Non-text portions of this message have been removed]





[Non-text portions of this message have been removed]



------------------------------------

Useful links for the Yahoo!Groups Vantage Board are: ( Note: You must have
already linked your email address to a yahoo id to enable access. )
(1) To access the Files Section of our Yahoo!Group for Report Builder and
Crystal Reports and other 'goodies', please goto:
http://groups.yahoo.com/group/vantage/files/.
(2) To search through old msg's goto:
http://groups.yahoo.com/group/vantage/messages
(3) To view links to Vendors that provide Vantage services goto:
http://groups.yahoo.com/group/vantage/linksYahoo! Groups Links
Hi All,

This is the story of my weekend, but before I go any further I'd like to
put here a GIANT disclaimer, I DO NOT recommend you do this and if you do
it and your stuff BREAKS I am NOT responsible, I am simply sharing my
experience.

We are getting ready to do the move to 9.05 from 9.04 and before I do the
big move I wanted to do a D&L (Dump and Load) to defrag the DB (we are
progress). Our DB was 15GB and it was running DOG slow. On Friday I spent
the major part of the day getting ready, set up the files and folder and at
5 O'clock sharp I started the Dump.

A few minutes later the dump of the schema was done and I moved on to the
dump of the data, I was expecting this to take "HOURS UPON HOURS" as many
had warned, so I let it be and came back to it 4 hours later. The process
was done.

I started the schema load and let it run for about 1 hour and then once the
process was complete I was ready to start the data Load. I went to the dump
folder and out curiosity I sorted the Files by size, I wanted to see which
one of my "MASSIVE" tables was the biggest, lo and be hold once I did the
sort by size I was surprised to see a 6GB table, it was called
"sysactivitylog" with a name like that it obviously called my attention and
I started poking around, it turns out its a transaction log table that you
can enable in your company configuration under System -> General Settings,
this table logs EVERYTHING that happens in your system and thus it grows
and grows and grows.

On that same article in Epic Web it mentioned that 9.05 has a purge program
that can be run to empty this DB, obviously I am not on 9.05 yet so I
decided to take a risk, during the Data Load part of the D&L I removed the
sysactivitylog from the load folder and let the load process. After a few
hours the process was done and the only error was "Couldn't Find
sysactivitylog", I ran a records count on all the tables before and after
and everything matched (Except the sysactivitylog)

I restored the DB into Test and it worked like a charm, the DB went from
15GB to 3 GB after D&L (small enough to shove most of it in ram), we are
running the production system on this today, and I keep waiting for the
other shoe to drop, but at the moment everything seems to be running
smoothly and our DB is WAYYYY smaller now. After the DB came back up, I
went into Company Config and disabled System Activity Tracking to prevent
this table from becoming huge again.

Again I am NOT recommending you do this, I am simply sharing my experience,
if you have any thoughts or experience with this I would love to hear it

Thanks!


*Jose C Gomez*
*Software Engineer*
*
*
*checkout my new blog <http://www.usdoingstuff.com> *
*
*T: 904.469.1524 mobile
E: jose@...
http://www.josecgomez.com
<http://www.linkedin.com/in/josecgomez> <http://www.facebook.com/josegomez>
<http://www.google.com/profiles/jose.gomez> <http://www.twitter.com/joc85>
<http://www.josecgomez.com/professional-resume/>
<http://www.josecgomez.com/feed/>
<http://www.usdoingstuff.com>

*Quis custodiet ipsos custodes?*


[Non-text portions of this message have been removed]
Also did you check your ABTWork file? This has a bunch of temporary
transactions that are used in financial transactions. There is a purge
program that came out in 905.606, but I'm not sure what it does as it
still leave a few hundred records in the file after it is done. ( I had
40,000 + records that were deleted when the program ran).



From: vantage@yahoogroups.com [mailto:vantage@yahoogroups.com] On Behalf
Of Jose Gomez
Sent: Monday, January 23, 2012 10:05 AM
To: Vantage
Subject: [Vantage] Our DB is now a Furth of what it used to be??????





Hi All,

This is the story of my weekend, but before I go any further I'd like to
put here a GIANT disclaimer, I DO NOT recommend you do this and if you
do
it and your stuff BREAKS I am NOT responsible, I am simply sharing my
experience.

We are getting ready to do the move to 9.05 from 9.04 and before I do
the
big move I wanted to do a D&L (Dump and Load) to defrag the DB (we are
progress). Our DB was 15GB and it was running DOG slow. On Friday I
spent
the major part of the day getting ready, set up the files and folder and
at
5 O'clock sharp I started the Dump.

A few minutes later the dump of the schema was done and I moved on to
the
dump of the data, I was expecting this to take "HOURS UPON HOURS" as
many
had warned, so I let it be and came back to it 4 hours later. The
process
was done.

I started the schema load and let it run for about 1 hour and then once
the
process was complete I was ready to start the data Load. I went to the
dump
folder and out curiosity I sorted the Files by size, I wanted to see
which
one of my "MASSIVE" tables was the biggest, lo and be hold once I did
the
sort by size I was surprised to see a 6GB table, it was called
"sysactivitylog" with a name like that it obviously called my attention
and
I started poking around, it turns out its a transaction log table that
you
can enable in your company configuration under System -> General
Settings,
this table logs EVERYTHING that happens in your system and thus it grows
and grows and grows.

On that same article in Epic Web it mentioned that 9.05 has a purge
program
that can be run to empty this DB, obviously I am not on 9.05 yet so I
decided to take a risk, during the Data Load part of the D&L I removed
the
sysactivitylog from the load folder and let the load process. After a
few
hours the process was done and the only error was "Couldn't Find
sysactivitylog", I ran a records count on all the tables before and
after
and everything matched (Except the sysactivitylog)

I restored the DB into Test and it worked like a charm, the DB went from
15GB to 3 GB after D&L (small enough to shove most of it in ram), we are
running the production system on this today, and I keep waiting for the
other shoe to drop, but at the moment everything seems to be running
smoothly and our DB is WAYYYY smaller now. After the DB came back up, I
went into Company Config and disabled System Activity Tracking to
prevent
this table from becoming huge again.

Again I am NOT recommending you do this, I am simply sharing my
experience,
if you have any thoughts or experience with this I would love to hear it

Thanks!

*Jose C Gomez*
*Software Engineer*
*
*
*checkout my new blog <http://www.usdoingstuff.com> *
*
*T: 904.469.1524 mobile
E: jose@... <mailto:jose%40josecgomez.com>
http://www.josecgomez.com
<http://www.linkedin.com/in/josecgomez>
<http://www.facebook.com/josegomez>
<http://www.google.com/profiles/jose.gomez>
<http://www.twitter.com/joc85>
<http://www.josecgomez.com/professional-resume/>
<http://www.josecgomez.com/feed/>
<http://www.usdoingstuff.com>

*Quis custodiet ipsos custodes?*

[Non-text portions of this message have been removed]





[Non-text portions of this message have been removed]