Senior Software Engineer

• Job Title: Senior Software Engineer (multiple positions open)
• Worksite Location: 260 Townsend St, Suite 650, San Francisco, CA, 94107

Job Description

1. Design and develop scalable backend systems using Flink, Spark, Vitess, and TiDB, leveraging scalable data modeling and pipeline design and reliability principles to support AI-driven freight matching, ensuring seamless handling of high volumes of communications and data.
2. Lead the end-to-end development of features from initial concept through to deployment, applying event-driven and workflow system design patterns while making key technical and design decisions to maximize impact and user satisfaction.
3. Engage directly with customers and cross-functional teams to gather insights for analytics systems architecture refinements, ITSM integration engineering, and delivery of workflow solutions that streamline freight logistics and improve user experience.
4. Contribute to both backend and frontend platform development, incorporating LLM Orchestration and Tool-Calling Patterns and selecting appropriate Java, Python, Airflow, and Mysql technologies, agentic frameworks, and abstractions to maintain a balance between development speed and system reliability.
5. Architect and optimize system performance through advanced analytics systems architecture, data modeling, caching strategies, and workflow integration to ensure reliability and scalability under peak load conditions.
6. Collaborate with data science and product teams to integrate machine learning models into the platform, enabling real-time freight matching and predictive analytics using Flink, Spark, and TiBD for fast, reliable data ingestion and inference.
7. Plan and execute the Workflow aspect of TiDB Migration and implement rigorous testing, monitoring, and observability frameworks to ensure code quality, system integrity, and operational excellence.
8. Drive continuous integration and continuous delivery (CI/CD) initiatives, automating workflows and working with tech leads to implement Analytics Framework rewrite using Python to improve deployment speed and overall engineering efficiency.
9. Participate in shaping the engineering culture by setting best practices and mentoring new team members to support the company's growth and innovation.

Minimum Requirements: Bachelor’s (or foreign educ. equiv.) Degree in Computer Science, Computer Engineering, or a related field plus three (3) years’ experience in the job offered or related occupation.

Special Skill Requirements

• a) Use of Python, Agentic Frameworks, Postgres, Redis, Debugging and API Integrations.
• b) Working with Tech Leads to implement Analytics Framework rewrite using Python.
• c) Knowledge with LLM Orchestration & Tool-Calling Patterns.
• d) Experience in Event-Drive/Workflow Systems Design, ITSM Integration Engineering, and Analytics Systems Architecture.
• e) Experience in Scalable Data Modeling, and Pipeline Design and Reliability.
• f) Use of Flink, Spark and TiBD.
• g) Planning and executing the Workflow aspect of TiDB Migration.
• h) Use of Java, Airflow, Vitess, Kafka, and Mysql.
• Base Salary: $200,000.00 per annum. 40 hours per week; M-F.