Software Developer/Engineer philadelphia pa
Software Developer/Engineer (Mid Level experience) philadelphia
Location: Philadelphia | Work Mode: Hybrid, minimum 3 days in the office
Interview Schedule: 1 st interview, 1-hour, in-person; 2 nd interview, 1-hour, in-person
Consultant Requirements – On-Prem LLM & Vector DB Implementation
Core Experience
Hands-on experience deploying open-source LLMs such as Meta Llama 3 and Mistral / Mixtral in on-prem or private environments
Strong proficiency in Python for LLM inference, prompt engineering, and integration
Experience with CPU-based inference, model quantization, and performance tuning
Vector Databases & RAG
Practical experience with open-source vector databases such as Qdrant, Chroma, Milvus, or pgvector
Proven implementation of Retrieval-Augmented Generation (RAG) pipelines
Experience generating and managing embeddings and metadata filtering
Security & Governance
Understanding of data privacy, air-gapped deployments, and enterprise security requirements
Experience implementing access controls and audit logging
Nice to Have
Experience with LangChain or LlamaIndex
Exposure to Rust, Go, or C++ for high-performance services
Familiarity with Docker and Kubernetes for on-prem deployments
Knowledge of inference frameworks (e.g., vLLM, llama.cpp, Hugging Face Transformers)
Prior work in regulated or enterprise environments
Deliverables
Reference architecture and deployment guidance
Working prototype (LLM + vector DB + RAG)
Documentation and knowledge transfer to internal teams
Recommended Jobs
Project Manager - Bridge Engineer
Job description: A respected and well-established engineering consultancy is seeking an experienced Project Manager Bridge Engineer to take the lead on complex bridge and structural projects ac…
Server
Dante and Luigi's Italian Fine Dining Restaurant is seeking a Full Time EXPERIENCED FINE DINING Server. Must have knowledge of Italian Cuisine and Fine Dining Experience. Must have open availab…
Sales Representative - Greater Philadelphia
The Opportunity Avantor is searching for a driven and resourceful Sales Representative to join its Commercial Sale team in the Greater Philadelphia market. Under general supervision, this role wil…
Quality Manager
Hydro Extrusions is a world-leading aluminium extrusion business counting around 100 production sites in 40 countries and employing 20,000 people. Through our unique combination of local expertise, g…
Sale Associate
Job Responsibilities: Welcome customers into the Medicare Center and point them in the right direction to meet their needs. Coordinate sales consultation meetings Maintain friendly and welcomin…
Product Manager, Surgical Instruments
B. Braun Medical Inc., a leader in infusion therapy and pain management, develops, manufactures, and markets innovative medical products and services to the healthcare industry. Other key product are…
Dental Hygienist (East Norriton)
Now Hiring: Dental Hygienist Plymouth Meeting Family Dental! (350 E. Germantown Pike East Norriton, PA 19401) Plymouth Meeting Family Dental , a thriving 2Doctor practice , is excited to welcome…
Copywriting Internships (Philadelphia) - Publicis Health
Company description At Publicis Health, we believe keeping the world healthy is our most extraordinary social endeavor. Because one person's wellbeing is the responsibility of the many. As part…
Deputy Sheriff (Part-Time)
Seeking two part-time deputy sheriff to enforce state and local laws relating to public safety and public welfare. Essential duties include performing security duties for County of Blair Courthouse; …
Fraud Servicing ATM Debit
At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. We do this by driving Responsible Growth and delivering for our …