Python + PySpark - Junior Developer Job at Compunnel, Inc., New York, NY

TVBjbW00RTVoaS9KTzZlVkVha2pISGZnc0E9PQ==
  • Compunnel, Inc.
  • New York, NY

Job Description

The Python + PySpark Junior Developer will be responsible for developing scalable data solutions using PySpark and Python. The role requires hands-on experience in data engineering, SQL, and cloud platforms such as AWS or Azure. The candidate should have strong problem-solving skills and experience in building efficient ETL pipelines for large-scale data processing. Key Responsibilities Develop and maintain data processing pipelines using Python and PySpark Design and implement ETL workflows for structured and unstructured data Optimize data storage, retrieval, and transformation processes Work with cloud platforms (AWS or Azure) to deploy and manage data solutions Write complex SQL queries for data transformation and analysis Collaborate with data engineers, analysts, and stakeholders to ensure data integrity and reliability Troubleshoot and resolve performance issues in data pipelines Required Qualifications 5+ years of experience in data engineering Strong proficiency in Python and object-oriented programming Hands-on experience with PySpark for large-scale data processing Proficiency in SQL for data manipulation and query optimization Experience with cloud platforms (AWS or Azure) Knowledge of ETL processes and data warehousing concepts Experience with Hadoop is acceptable Preferred Qualifications Experience in optimizing Spark jobs for performance and efficiency Familiarity with DevOps practices for data engineering Understanding of data governance and security best practices #J-18808-Ljbffr Compunnel, Inc.

Job Tags

Similar Jobs

Pacific Life

Senior Actuary (FSA) - Life Product Management Job at Pacific Life

 ...The experience you bring: ~6+ years of actuarial working experience in a financial institution or insurance company. ~ FSA designation ~ Bachelors degree in Actuarial Science, Mathematics, or a related field ~ Strong quantitative, analytical, organizational... 

Norlee Group (NLG)

Director of Safety Job at Norlee Group (NLG)

 ...across the organization. About the Role The Director of Safety is responsible for leading the Norlee Group Safety...  ...companies. What Youll Bring ~ Bachelors degree in Occupational Health & Safety, Environmental Science, Engineering, or a related discipline... 

Clover Express Inc

Class A Looking for OTR CDL CLASS A Drivers,Owner Operators,Teams Job Job at Clover Express Inc

Class A Looking for OTR CDL CLASS A Drivers,Owner Operators,Teams JobRun all 48 States, Minimum 3 weeks on the road.Pay: $3000-$5000 per weekWe offer 2021-2023 Freightliner Cascadia and Volvo trucks, new trailers, 24/7 Dispatch,Direct Deposit Weekly,Cash Advances.... 

BOEING

Inspector Assembly & Installation - 51406 Job at BOEING

 ...Inspector Assembly & Installation - 51406 at BOEING summary: The Inspector Assembly and Installation role at Boeing involves inspecting aircraft assemblies and installations to ensure quality and compliance with specifications. The position requires collaboration with... 

CommonSpirit Health

Internal Medicine, Internal Medicine Physician Job at CommonSpirit Health

 ...Group Stockton , a service of Dignity Health Medical Foundation, is seeking a full-time, board-certified or board-eligible Internal Medicine Physician to join our team in Stockton, California. If youre eager to practice where collaboration meets compassion and every...