Importing records

Yahoo Archive
1
Thanks guys ill perhaps run along those lines. I agree that SC is slow
and that it can be a bit painful at times to develop those workflows but
it does have its uses in certain situations (esp for those of use that
don't have a programming background). It does a decent job at being
able to apply rules based decision making in manipulating data. We find
it most useful to integrate 3rd party software systems. But I wont make
too much hash of what you said since you were so kind to help!!



Rob Bucek

Manufacturing Engineer

PH: 715-284-5376 ext 311

FAX: 715-284-4084

<http://www.dsmfg.com/>

(Click the logo to view our site)



________________________________

From: vantage@yahoogroups.com [mailto:vantage@yahoogroups.com] On Behalf
Of Vic Drecchio
Sent: Thursday, March 26, 2009 10:08 AM
To: vantage@yahoogroups.com
Subject: RE: [Vantage] Importing records



I do this very frequently.

You, like us, are very lucky to be SQL based. I'd have it no other way.

Service Connect sucks. I don't care what anybody says. It's slow,
clunky, hard on resources, convoluted to develop/configure/manage, and
consumes way too much memory. Figure 1000 records per hour, roughly,
using Service Connect.

If you are simply pumping data into a UD table, then there is almost
zero risk as this isn't a complicated system table with dependencies.
Use a DTS package to automate this for you and run it in a SQL agent on
the days/times you desire. Dump your XLS into the same folder with the
same name weekly and let DTS do the magic for you.

Vic

-----Original Message-----
From: vantage@yahoogroups.com <mailto:vantage%40yahoogroups.com>
[mailto:vantage@yahoogroups.com <mailto:vantage%40yahoogroups.com> ] On
Behalf
Of rob.bucek
Sent: Thursday, March 26, 2009 10:45 AM
To: vantage@yahoogroups.com <mailto:vantage%40yahoogroups.com>
Subject: [Vantage] Importing records

I would like to import some records from a csv or xls file(s) once a
week; in the neighborhood of 6 to 10 thousand records to a UD table.
Each time i import these I would like to delete all the records before
importing the new set. My concern is that service connect will take
entirely too long to do this process. Is that assumption correct? What
would be the most efficient way to slam these records into a UD table?
Im not necessarily adverse to writing to the table directly (we have an
SQL database). Any suggestions out there for how I could accomplish
this?

------------------------------------

Useful links for the Yahoo!Groups Vantage Board are: ( Note: You must
have already linked your email address to a yahoo id to enable access. )
(1) To access the Files Section of our Yahoo!Group for Report Builder
and Crystal Reports and other 'goodies', please goto:
http://groups.yahoo.com/group/vantage/files/.
<http://groups.yahoo.com/group/vantage/files/>
(2) To search through old msg's goto:
http://groups.yahoo.com/group/vantage/messages
<http://groups.yahoo.com/group/vantage/messages>
(3) To view links to Vendors that provide Vantage services goto:
http://groups.yahoo.com/group/vantage/linksYahoo
<http://groups.yahoo.com/group/vantage/linksYahoo> ! Groups Links





[Non-text portions of this message have been removed]
2
I would like to import some records from a csv or xls file(s) once a week; in the neighborhood of 6 to 10 thousand records to a UD table. Each time i import these I would like to delete all the records before importing the new set. My concern is that service connect will take entirely too long to do this process. Is that assumption correct? What would be the most efficient way to slam these records into a UD table? Im not necessarily adverse to writing to the table directly (we have an SQL database). Any suggestions out there for how I could accomplish this?
3
My understanding is that in the SQL environment all of the triggers are in place to enable you to do this. Since you're working with the UD tables, there's no underlying business logic to have to worry about.

So you could use MSSQL SSIS to do the import, and just "delete * from UD10" or whatever as part of the import process.

Obviously you'd want to test this thoroughly.

-bws

--
Brian W. Spolarich ~ Manager, Information Services ~ Advanced Photonix / Picometrix
    bspolarich@... ~ 734-864-5618 ~ www.advancedphotonix.com


-----Original Message-----
From: vantage@yahoogroups.com [mailto:vantage@yahoogroups.com] On Behalf Of rob.bucek
Sent: Thursday, March 26, 2009 10:45 AM
To: vantage@yahoogroups.com
Subject: [Vantage] Importing records

I would like to import some records from a csv or xls file(s) once a week; in the neighborhood of 6 to 10 thousand records to a UD table. Each time i import these I would like to delete all the records before importing the new set. My concern is that service connect will take entirely too long to do this process. Is that assumption correct? What would be the most efficient way to slam these records into a UD table? Im not necessarily adverse to writing to the table directly (we have an SQL database). Any suggestions out there for how I could accomplish this?



------------------------------------

Useful links for the Yahoo!Groups Vantage Board are: ( Note: You must have already linked your email address to a yahoo id to enable access. )
(1) To access the Files Section of our Yahoo!Group for Report Builder and Crystal Reports and other 'goodies', please goto: http://groups.yahoo.com/group/vantage/files/.
(2) To search through old msg's goto: http://groups.yahoo.com/group/vantage/messages
(3) To view links to Vendors that provide Vantage services goto: http://groups.yahoo.com/group/vantage/linksYahoo! Groups Links
4
I do this very frequently.

You, like us, are very lucky to be SQL based. I'd have it no other way.

Service Connect sucks. I don't care what anybody says. It's slow,
clunky, hard on resources, convoluted to develop/configure/manage, and
consumes way too much memory. Figure 1000 records per hour, roughly,
using Service Connect.

If you are simply pumping data into a UD table, then there is almost
zero risk as this isn't a complicated system table with dependencies.
Use a DTS package to automate this for you and run it in a SQL agent on
the days/times you desire. Dump your XLS into the same folder with the
same name weekly and let DTS do the magic for you.



Vic




-----Original Message-----
From: vantage@yahoogroups.com [mailto:vantage@yahoogroups.com] On Behalf
Of rob.bucek
Sent: Thursday, March 26, 2009 10:45 AM
To: vantage@yahoogroups.com
Subject: [Vantage] Importing records

I would like to import some records from a csv or xls file(s) once a
week; in the neighborhood of 6 to 10 thousand records to a UD table.
Each time i import these I would like to delete all the records before
importing the new set. My concern is that service connect will take
entirely too long to do this process. Is that assumption correct? What
would be the most efficient way to slam these records into a UD table?
Im not necessarily adverse to writing to the table directly (we have an
SQL database). Any suggestions out there for how I could accomplish
this?



------------------------------------

Useful links for the Yahoo!Groups Vantage Board are: ( Note: You must
have already linked your email address to a yahoo id to enable access. )
(1) To access the Files Section of our Yahoo!Group for Report Builder
and Crystal Reports and other 'goodies', please goto:
http://groups.yahoo.com/group/vantage/files/.
(2) To search through old msg's goto:
http://groups.yahoo.com/group/vantage/messages
(3) To view links to Vendors that provide Vantage services goto:
http://groups.yahoo.com/group/vantage/linksYahoo! Groups Links