Jobs / Senior AI Software Engineer
Jobs at Autify

Senior AI Software Engineer

Autify Tokyo | Hybrid
EN: business
JP: none
Employment Type
Full time

Job Description

Since its official release in October 2019, Autify has been implemented by numerous clients, and our client base is continuing to grow. While we provide all the essential functions required in a test automation platform, we continue to receive requests for new functions and improvements. Autify is working on growing the product further by adding new features. Also, we are looking for opportunities beyond the existing Autify services. To expand our product lineup, we are looking for an AI engineer who focuses on prompt engineering to fully utilize the LLMs’ power, and building LLM-powered PoC applications in Python.

You will mainly be responsible for developing a new product utilizing machine learning techniques and generative AI from a proof of concept into a releasable product.


¥8,000,000 - ¥10,000,000 a year

Reviewed twice a year


  • Create effective prompts to maximize the quality of the output from LLMs based on the product specifications
  • Create PoC Web/CLI applications that use LLMs or ML under the hood to validate the feasibility of ideas
  • Build our machine learning models using data relevant to the software testing if needed
  • Work with other engineers, designers, and product leads to implement various features while considering performance, security, and reliability
  • Proactively identify functions that can be improved, and suggest possible solutions in the technical aspects and product-related ideas
  • Participate in on-call rotations for incident & alert handling


Required Qualifications

  • 2+ years of technical experience with Python and 5+ years of experience in software development
  • Experience in developing APIs with FastAPI and web applications
  • Over a year of experience in prompting open-source and closed-source LLMs
  • Has good comprehension and familiarity with CSS and HTML
  • Up to date with the latest Machine Learning Research especially on LLMs and Prompt Engineering 
  • Experience in building metrics for evaluating various tasks LLMs
  • Being able to work in Japan standard time (Working partially in JST can be discussed)
  • Ability to communicate and work in English


  • Over two years of experience in training and customizing deep learning models, especially LLMs
  • Knowledge of natural language processing and visual recognition
  • Proficient in the process of analyzing, hypothesizing, and testing
  • Experience in MLOps
  • Modern development experience with Agile or Scrum
  • Experience in E2E test automation with test automation frameworks like Playwright, Cypress, Selenium, Appium, and etc.

About the Company

Autify, Inc. is a start-up company founded in San Francisco by a team of engineers who were the first Japanese team to graduate from the top US accelerator, Alchemist Accelerator. With the mission to increase creativity with the power of tech, we develop and provide Autify, an AI-powered software testing automation platform. 

In October 2019, we officially released Autify for Web, our test automation software that targets web applications. Also, in October 2021, Autify for Mobile for mobile app testing was officially launched, and we closed our $10M Series A. Although the product lineup is continuing to expand, and we have been able to provide all basic functions needed in a test automation platform, we continue to receive requests for new features and improvements.

Selection Process

1. Submission of online coding test (take-home)

2. Submission of technical assignment (take-home)

3. Technical interview & HR interview: 90 mins

4. Final interview: 60 mins


  • We will request to provide references after the final interview.
  • The interview steps might change depending on the hiring status in our pipeline.
  • We can arrange casual interviews before the coding test upon the candidate's request. (Subject to availability of both parties)

About the Engineering Team

Our Team

Autify's engineering team is international, with more than half of the engineers being foreign nationals and all developers being English speakers. We have a good culture where members respect each other's backgrounds. Since we have two products, Autify for Web and Autify for Mobile, our development engineers are divided into two teams corresponding to each product. We have about 30 front-end, back-end, and technical support engineers who work closely with engineering managers, product managers, QA managers, designers, and machine learning engineers. The product manager is in charge of the general roadmap. The product manager develops a rough roadmap and works with the engineers and designers on the details of each feature and bug fixes before implementation. Depending on the size of the feature, we appoint a feature lead from among the engineers to be in charge of the project and give them the discretion to make technical decisions.

Our Development Process

We create a ticket about what kind of function we will develop. In some cases, the product owner creates it based on user feedback; in other cases, each team creates bugs and investigation requests directly.

The development cycle consists of one Sprint, which takes two weeks. Development tasks are assigned during the planning stage on the first day of the Sprint, and we hold a daily standup meeting to check the overall progress and any problems. (If there is a time difference, it is done at lunchtime).

We review code on GitHub. After the review, the merged branches are automatically deployed to the staging environment, and E2E tests are performed (which Autify does itself).

After testing on the integrated branch, it's deployed to the production environment. Deployment is done several times a week as needed. We also hold sprint ceremonies like Sprint planning, feature refinement and sprint retrospective sessions. The developer will demonstrate the developed function to all employees at the end of the Sprint in the Sprint Demo.

Tech Stack

  • Backend: Ruby, Ruby on Rails, Go
  • Frontend: JavaScript, TypeScript, React, Redux, Styled Components
  • Machine learning: Python, PyTorch, Kubernetes, GPT-4
  • Database: PostgreSQL, Redis
  • Test: Appium, Selenium, WebdriverIO, Puppeteer
  • Infrastructure: AWS, Docker, Terraform, Packer, MacStadium, GoogleCloud
  • Monitoring: Datadog, New Relic, Sentry
  • CI/CD: CircleCI, GitHub Actions
  • Source code management: GitHub
  • Project management: Jira
  • Misc.: G Suite, Slack, Notion, Gather, Zoom, Miro, 1Password, Mixmax, Calendly, etc.

Employment Conditions

Employment Status

  • Regular employees
  • Probation period: 3 months after joining the company (conditions are the same as permanent employment)

Work Location

  • Tokyo office or Remote (Hybrid)

Work Hours

  • Full flextime system

Note: The determination of working hours (start and end times) must be made to the extent that one's own duties (including guidance and supervision of subordinates) are properly performed and that there are no obstacles to work in terms of coordination and communication with other employees.


  • Twice a year


  • Complete a five-day workweek system (National holidays, year-end and New Year holidays, etc.)
  • Unlimited paid time off


  • Equipped with various social insurance
  • Regular health checkups
  • Stock option
  • A laptop PC will be rented when joining the company
  • Remote work allowance
  • English learning support
  • Skill-up support
  • Visa sponsorship
  • Relocation bonus
  • Relocation housing support