Data Engineer
CurrentBuild complex ADF pipelines to solve business needs like process data to Snowflake or SSMS when data is present and ready to be loaded based on changing parameters and variablesCreate and enhanced python scripts to process data from files, APIs, and different servers to Snowflake or SSMS through Apache Airflow on desired scheduleConfigure ETL processes in Snowflake, SSMS, ADF, SSIS, and Apache AirflowWork with different areas of the organization to gather data needed to fulfill tasksRealize and implement areas of processes that can be improved or enhanced for cost management or to decrease processing powerCreate tables, views, functions, procedures, tasks, and jobs to automatically run to meet business requirementsWork within a team as well as individually to identify and solve complex business problems