Role: Lead PySpark Engineer
Job type: Fulltime
Location: Owings Mill, MD
Roles & Responsibilities:
10+ years of experience in big data and distributed computing.
• Very Strong hands-on experience with PySpark, Python, Airflow, DBT & DWH concepts
• Strong Hands on experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.).
• Proficiency in data modeling and ETL workflows.
• Proficiency with workflow schedulers like Airflow
• Hands on experience with AWS cloud-based data platforms.
• Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus.
• Strong problem-solving skills and ability to lead a team
Develop, test and maintain high-quality solutions using PySpark /Python programming language.
· Participate in the entire software development lifecycle, building, testing and delivering high-quality
data pipelines.
· Collaborate with cross-functional teams to identify and solve complex problems.
· Write clean and reusable code that can be easily maintained and scaled.
· Keep up to date with emerging trends and technologies in Python development. Design and develop
business controls using AWS Glue and PySpark
· Integrate data from various sources into Amazon Redshift
· Optimize performance of data processing jobs and fine tune queries
Salary Range: $110,000 - $115,000 a Year
...Job Description: Infosys is seeking a ETL Developer with Snowflake, AWS Redshift - This positions primary responsibility will be to translate software requirements into working and maintainable solutions within the existing application frameworks. The chosen candidate...
...facilities nationwide, partnering with hospitals, health systems, and physician groups across the US. They are seeking an Assistant General Counsel to report directly to the General Counsel and directors and will perform all responsibilities relating to legal services...
...Pay: Based on experience Employment Type : Temp-to-Hire Are you handy with a tile cutter and a master of clean lines? Were looking for a skilled Flooring & Tile Installer to join a team in Cuero, TX, where youll work on residential flooring and tile projects...
...., Asana, Jira, MS Project). Familiarity with financial services industry regulations and standards. Experience working with remote teams. Strong analytical and problem-solving skills. What We Offer Opportunity to work with a leading financial services...
Our client is urgently seeking a proactive, high-energy individual for this hands-on role-where your work ethic and reliability will make a real impact! We're hiring a Full-Time Equipment Delivery & Inventory Coordinator to join our fast-paced team in Carrollton, ...