Senior Python Developer

Responsibilities

• 5+ years of experience utilizing Python, PySpark/Scala for processing large data volumes
• Good knowledge of working with Databases (e.g., SQL, Oracle, Hive, Impala)
• Relevant experience with Pandas, NumPy, Scikit-learn, and other relevant Python libraries
• Google Cloud Platform (DataProc, AirFlow, Google Cloud Storage)
• Good knowledge of Unix/Linux environments
• Familiarity with Big Data and Hadoop Ecosystem: Spark (Spark SQL, Dataframes, PySpark, HUE, parquet files)
• Awareness about DevOps practices like CI/CD
• Proficient communication and English language skills (written/verbal)

Skills

• PySpark (Python, PySpark or Scala)
• Spark DataFrames
• ETL concepts
• Database and SQL knowledge (Hive/Impala)