Open Source AI / LLM Deployment & Automation Expert

IF YOU CANNOT DEPLOY OPEN SOURCE AI MODELS ON A SELF-HOSTED SERVER, PLEASE DO NOT APPLY.

We are a growing company looking for a skilled, hands-on Open Source AI / LLM Expert who can deploy, configure, and maintain large language models (LLMs) on our in-office server — with zero per-token or API costs. This is a full-time role with major growth potential as AI becomes central to everything we do.

---

ABOUT THE ROLE

You will be responsible for setting up and managing a self-hosted AI infrastructure on our in-house server and then implementing AI-powered automation across multiple departments. We use NO paid AI APIs (no OpenAI, no Anthropic, no paid tokens). Everything must run locally or on infrastructure we control.

---

?? HARD REQUIREMENT — MUST HAVE BEFORE APPLYING:

? Proven, hands-on experience deploying open source LLMs on a self-hosted Linux/Windows server (e.g., using Ollama, LM Studio, LocalAI, vLLM, Hugging Face Transformers, llama.cpp, or similar)
? Experience with models such as LLaMA, Mistral, Mixtral, Phi, DeepSeek, Falcon, Qwen, or similar open source LLMs
? Ability to set up GPU/CPU inference environments and optimize model performance
? Experience integrating self-hosted LLMs into real-world workflows and applications

If you do not have ALL of the above, please do not apply. We will verify your experience with a technical screening.

---

KEY RESPONSIBILITIES

1. SERVER SETUP & LLM DEPLOYMENT
- Install and configure our in-office server for AI inference (GPU/CPU)
- Deploy and manage multiple open source LLMs (LLaMA, Mistral, Mixtral, DeepSeek, etc.)
- Set up inference frameworks: Ollama, vLLM, LocalAI, llama.cpp, or equivalent
- Ensure models are stable, fast, and accessible to our internal tools and team
- Keep models updated and add new open source models as they are released
- Set up APIs/endpoints so our internal apps can communicate with the hosted models

2. GOVERNMENT CONTRACTING AUTOMATION
- Build an AI-powered system to search and identify government contract opportunities ( ---------- , GovWin, USASpending, state portals, etc.)
- Automate research on each bid: scope of work, incumbent contractors, agency budgets, past award amounts
- Use LLMs to analyze bid data and generate competitive pricing recommendations
- Assist in drafting and submitting multiple competitive bids simultaneously
- Build workflows that monitor new opportunities and alert the team

3. PPC & PAID ADS MANAGEMENT (Google Ads & Facebook Ads)
- Implement LLM-powered tools to research keywords, write ad copy, and optimize campaigns
- Automate performance analysis and bid adjustment recommendations for Google Ads and Facebook/Meta Ads
- Generate A/B test variations for ads using the self-hosted AI
- Build reporting dashboards that summarize campaign performance with AI-generated insights

4. SEO AUTOMATION
- Use self-hosted LLMs to generate SEO-optimized content, meta descriptions, title tags, and blog posts
- Automate keyword research and competitor analysis workflows
- Build tools to audit website content and suggest AI-generated improvements
- Integrate with tools like Screaming Frog, Ahrefs, SEMrush, or similar as needed

5. SOCIAL MEDIA MARKETING AUTOMATION
- Implement AI pipelines to generate, schedule, and manage social media content across platforms
- Use self-hosted LLMs to create platform-specific posts, captions, hashtags, and engagement responses
- Build automation workflows for content calendars and posting schedules
- Monitor and report on social media performance with AI-assisted summaries

---

REQUIRED SKILLS & EXPERIENCE

- Strong experience deploying and running open source LLMs on self-hosted hardware (MANDATORY)
- Proficiency with Python and/or Node.js for building AI integrations and automation
- Experience with LangChain, LlamaIndex, or similar frameworks for building LLM-powered apps
- Familiarity with RAG (Retrieval-Augmented Generation) pipelines and vector databases (Chroma, Weaviate, Pinecone, etc.)
- Knowledge of Linux server administration and Docker/containerization
- Ability to build and automate workflows (n8n, Make/Integromat, or custom scripts)
- Strong problem-solving skills and ability to work independently
- Good English communication skills (written and verbal)

BONUS / NICE TO HAVE:
- Experience with Google Ads API or Facebook Marketing API
- SEO tools experience (Ahrefs, SEMrush, Surfer SEO, etc.)
- Government contracting / ---------- experience
- Web scraping skills (BeautifulSoup, Playwright, Scrapy)
- Experience with fine-tuning or quantizing open source models (GGUF, GPTQ, AWQ)

---

WHY JOIN US?

- Full-time, long-term position with room to grow
- You will be THE AI expert for our company — high impact, high visibility role
- We are investing heavily in AI automation — this role will expand significantly
- Competitive salary based on experience
- Work with cutting-edge open source AI technology

---

HOW TO APPLY

Please include the following in your application or cover message:
1. List the specific open source LLM models you have deployed on a self-hosted server
2. What inference framework/stack did you use (Ollama, vLLM, llama.cpp, etc.)?
3. What was the server spec (GPU model, RAM, OS)?
4. Describe one real-world project where you used a self-hosted LLM to automate a business process

Applications without this information will not be considered. We look forward to hearing from experienced candidates only!