Skip to content
← Back to job listings

Data Engineer

Karya · Bengaluru, India

Data Science / AI / Machine LearningImported listingfull-timeabout 2 hours ago

About The Role

<p><strong>About Karya<br></strong><br>Karya provides AI-enabled earning and learning opportunities to economically underserved communities, and<br>high-quality, ethically sourced datasets to research labs and technology companies. Digital workers earn at least 20<br>times the local minimum wage. The platform has delivered over 40 million tasks.<br>About the role<br>This role runs live client projects on the Karya platform. The work is the execution layer above the core product:<br>project workflows, data jobs, checks, reports, and delivery.<br>You will work with Operations and client teams on questions of progress, quality, pay, and files, and with platform<br>engineers when a fix belongs in the product. Worker payouts and client deliverables depend on getting these checks<br>right.<br><br><strong>Responsibilities</strong><br>• Run and monitor data jobs on remote Linux servers, and recover failed jobs from logs and process state.<br>• Configure project workflows, including the handoff from automated processing to human tasks, and track what<br>is in progress, held, or ready to deliver.<br>• Write PostgreSQL and ClickHouse queries for throughput, completion, quality, pay, and delivery status.<br>• Apply completion and quality rules to access, pay, and delivery decisions, after a sample check.<br>• Write Python, SQL, or Bash scripts for those checks and decisions, and keep them in the repository.<br>• Package datasets to client specifications, move them through cloud object storage, and record what has shipped.<br>• Read the TypeScript / Node.js codebase to follow tasks, assignments, payments, and file storage.<br>• Reply to Operations and client teams with the finding, the change made, and what is still open.<br>• Report repeated manual work to platform engineering, with an example.<br><br><strong>Requirements</strong><br>• PostgreSQL, including joins, aggregates, and JSON fields.<br>• Scripts in Python, Bash, or TypeScript, checked into git.<br>• Ability to read a TypeScript codebase and a relational schema.<br>• Linux for running jobs: SSH, logs, long-running processes, and disk.<br>• Ability to write technical updates that give non-technical teammates a clear picture of the situation.<br>• Queries or scripts already run against real project or production data.<br><br><strong>Good to have</strong><br>• Cloud object storage (Google Cloud Storage, S3, or Azure Blob).<br>• Experience with collected datasets such as speech, text, or images.<br>• ClickHouse, Metabase, or a similar reporting tool.<br><br><strong>Perks</strong><br>• Flexible leave, with remote or hybrid work.<br>• Health insurance.<br>• Direct work on data collection that determines worker earnings and client deliverables.<br><br>Karya is an equal opportunity employer. Applicants are considered without regard to race, religion, gender identity, sexual orientation,<br>disability, or any other protected status. For accommodations, contact [email hidden].</p>

This is an external listing. JobSpring does not represent or verify the employer. Report this listing