Remote Opportunity - Python-PySpark Developer Job at IT America Inc, Illinois

N3pPSDZEWlBidHgxTW1WSzcvQkN5NmRm
  • IT America Inc
  • Illinois

Job Description

Position: Python/PySpark Developer

Location: Remote

Duration: Long term contract

Job Summary

We are seeking a skilled and experienced Python/PySpark Developer with hands-on expertise in Databricks, Cloud platforms (AWS, Azure, or GCP), and CI/CD pipelines. The ideal candidate will design and develop scalable data pipelines, work on big data processing frameworks, and contribute to modern data architecture initiatives.

Key Responsibilities

  • Design, develop, and maintain data pipelines using PySpark and Python.
  • Proficiency in working with SQL, and relational and non-relational databases.
  • Work with Databricks to build scalable and high-performance ETL/ELT workflows.
  • Integrate and process structured and unstructured data from various sources.
  • Deploy solutions on any major cloud platforms (AWS, Azure, or GCP).
  • Implement CI/CD pipelines to automate build, test, and deployment processes.
  • Optimize data workflows for performance and cost efficiency.
  • Collaborate with Data Engineers, Data Scientists, and DevOps teams.
  • Maintain documentation of design decisions, architecture, and implementations.
  • Troubleshoot and resolve data pipeline issues in a timely manner.

Required Skills

  • 10+ years of experience with Python and PySpark.
  • Proficiency in working with SQL, and relational and non-relational databases.
  • Strong experience with Databricks (Delta Lake, notebooks, jobs, clusters, etc.).
  • Experience with one or more cloud platforms (AWS, Azure, GCP).
  • Solid understanding of CI/CD tools (e.g., GitHub Actions, Jenkins, Azure DevOps).
  • Experience with data orchestration tools (e.g., Airflow, Databricks Workflows).
  • Familiarity with data lake, data warehouse, and big data concepts.
  • Knowledge of version control systems like Git.
  • Strong problem-solving and debugging skills.

Preferred Qualifications

  • Experience with Terraform, Docker, or Kubernetes.
  • Exposure to machine learning pipelines or MLOps is a plus.
  • Certifications in Databricks or any Cloud Platform are a bonus.

Education

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.

Job Tags

Contract work, Remote job,

Similar Jobs

Enterprise Medical Recruiting

Urgent Care Physician Assistant in Portland, OR - $59 to $72/Hour Job at Enterprise Medical Recruiting

 ...An award-winning Urgent Care clinic that values collaboration, innovation, and inclusion is adding Family Medicine, Emergency Medicine, and Urgent Care experienced Physician Assistants to its value-based care team in Portland, Oregon. Enjoy the flexibility to practice... 

Bath Concepts Independent Dealers

Door & Window Installer Job at Bath Concepts Independent Dealers

 ...Join Our Team as a Door & Window Installer Immediate Opening! Are you looking for a new opportunity? We want to hear from you! NuFace Home Improvements, a fast-growing home remodeling company, is looking for a Door & Window Installer to join our team in the Toms... 

Johns Hopkins Medicine

Site Manager - Release of Information RHIA/RHIT Job at Johns Hopkins Medicine

 ...years of HIM leadership experience, for one year of education experience, i.e. 8 years. Required Licensure Certification, etc. RHIT Credential required. RHIA Credential preferred. Track 1: RHIA credential, with three years of progressive HIM experience.... 

BooksTime, Inc.

US Multi-Client Controller 100% Remote Job at BooksTime, Inc.

 ...This is a remote position. Are you looking for: ~ Flexible hours; ~100% remote work; ~ Friendly colleagues, and...  ...BooksTime is an ambitious, innovative accounting & bookkeeping startup founded in 2016 with operations in 5 countries. For more information... 

MRINetwork Jobs

Interim Manager of Radiology/Imaging Services - California Job at MRINetwork Jobs

 ...A respected community hospital in California is seeking an experienced InterimManagerto lead its Radiology/Imaging Services department. This leadership opportunity is ideal for a seasoned healthcare professional available to begin within the next few weeks. Position...