how to pass python variable to %%sql cell ? · jupyter-incubator/sparkmagic · Discussion #810

cometta
Mar 1, 2023

let say i have value in python variable call a= 'something'
in

%%sql 
select * from table_name where field = variable_a

I don't think this is possible. Instead, I would use regular pyspark to create a temp view matching the condition you need, like so

someDf.where(F.col('field') == x).createTempView('tmp')

and then separately run

%%sql
select * from tmp

0 replies