โ06-25-2020 01:43 AM
Hi Team,
I need to call below sample python script from snaplogic.
or is there a way to call .py file in snaplogic
import pandas as pd
################Can be snap logic pipeline###############333333
import pyodbc
conn = pyodbc.connect(โDRIVER={ODBC Driver 13 for SQL Server};
SERVER=ps-sql; database=test; trusted_connection=yesโ)
sql = โโโ
select * from temp
โโโ
df = pd.read_sql(sql, conn)
######################################################33
#######################Feed SQL into python######################3
import pandas as pd
longform = pd.DataFrame(columns=[โassets__cโ, โidโ])
for idx, songs, name in df.itertuples():
name_words = (i.lower() for i in name.split())
longform = longform.append(
[{โassets__cโ: nw, โidโ: songs} for nw in name_words],
ignore_index=True
)
longform[โrefreshdate_unpackโ] = pd.to_datetime(โtodayโ)
longform
##############Write longform into a sql table######################
โ12-11-2020 01:49 PM
Hi @rsramkoski
Even if he goes with RPE and Pandas, โฆ then what about pyodbc? Is it supported in RPE?
If you check the py-libs:
https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/615415845/Remote+Python+Executor+RPE+Insta...
Not only pyodbc, but all the other python connectors to the databases - how are they supported via RPE?
/Igor
โ12-11-2020 02:22 PM
@igormicev We do not restrict which third-party Python libraries work in the RPE snap. Custom scripts like this though would be outside the scope of our Support team, meaning they need to be supported by the team that develops them. What is the driving factor to use pyodbc or another Python library to connect to SQL Server instead of the SQL Server snap pack or JDBC snap pack?
โ12-19-2020 01:19 AM
Hi,
Thanks for the reply I have got RPS installed but I am not able to use external lib
import pyodbc
from pylab import title, figure, xlabel, ylabel, xticks, bar, legend, axis, savefig
from IPython.display import Math
Python script error: ModuleNotFoundError(โNo module named โpylabโโ,)
I need to conncet to SQL and read the data for further processing
what is required to use them in the remote python script?
โ12-12-2020 12:04 PM
@rsramkoski, thanks for your reply, it answered my question.
I donโt know whatโs the driving factor to use third-party libs instead of some of the snaps. I guess the OP would liked to make/try some data wrangling with DataFrame.