Part Time
$520/month
40
May 5, 2026
## Overview
You’ll review **flight data logbooks**, label and organize information, and verify that our AI-generated **JSON output** matches the source data correctly. You’ll also help build simple **evals/testing workflows** in tools like **LangSmith** and **Braintrust**.
This is a great fit for someone who is careful, organized, and comfortable working with structured data. You do **not** need to be a full engineer, but you should be somewhat technical and comfortable learning new tools.
## What You’ll Do
- Review and label aviation-related data, scanned documents, and especially **flight logbooks**
- Compare source inputs against AI-generated **JSON output**
- Check for accuracy, missing fields, formatting issues, and inconsistencies
- Flag bad outputs and provide clear notes on what went wrong
- Help create and maintain **evals** and testing datasets in platforms like **LangSmith** and **Braintrust**
- Work closely with our team to improve data quality and model performance
- Follow labeling guidelines and help refine them over time
## Requirements
- Strong attention to detail
- Good written English
- Comfortable working with spreadsheets, structured data, and repetitive review tasks
- Able to compare source documents against JSON or other structured outputs
- Basic technical comfort level: you don’t need to code heavily, but you should not be intimidated by JSON, QA workflows, or AI tools
- Reliable internet and ability to work independently
## Nice to Have
- Familiarity with **aviation**, flight operations, or pilot logbooks
- Experience with **data labeling**, QA, or annotation
- Experience using tools like **LangSmith**, **Braintrust**, or similar AI evaluation platforms
- Basic understanding of **JSON**
- Experience reviewing model outputs for consistency and correctness
## Ideal Candidate
- Very detail-oriented and consistent
- Comfortable spotting small errors
- Interested in AI / machine learning workflows
- Can follow instructions carefully and ask good questions when something is unclear
- Bonus if you have aviation exposure, but it is not required
## Compensation
- Hourly or part-time to start
- Potential for ongoing work if it’s a good fit
## To Apply
Please send:
1. A short introduction about yourself
2. Any experience with data labeling, QA, aviation, or JSON
3. Examples of tools you’ve used (spreadsheets, annotation tools, LangSmith, Braintrust, etc.)
4. Your hourly rate
5. Your availability
Also include the phrase **“Radar Ready”** in your application so we know you read this fully.