Back to essays
Career · GenAI · NLP

NLP + GenAI: a six-month path from data scientist to GenAI data scientist

2026-07-26 · 9 min read · audio 2:28
NLP + GenAI
Audio version · MiniMax TTS · male-qn-jingying

Why GenAI

GenAI is the most active hiring direction in 2026, across every industry. Compensation runs roughly twenty percent above classical data science for equivalent seniority. Mid-level GenAI data scientists in Shanghai cluster between seventy and one hundred K per month. People who can combine finance and AI are rare, and that is the leverage you have. With six-plus years in data, BI, and pricing, plus a freshly acquired NLP skill set, you are exactly the candidate the market is short on.

The six-month arc at a glance

MonthFocusPrimary outputWeeks
1NLP fundamentalsFinancial sentiment model4
2Transformer + LLMHand-written mini GPT6
3RAG + vector databasesEnterprise RAG for finance4
4Agent + multi-modalMulti-agent analyst4
5Capstone projectsThree portfolio repos4
6Search and interviewOffer in hand4

Budget ten to fifteen focused hours per week. Less than that and the projects slip; more than that and you burn out before the interview stretch.

Month 1 — NLP fundamentals

Two artifacts. A BERT sentiment classifier on a public dataset, and a Chinese-language earnings-call sentiment model built with uer/roberta-base-finance-dianping-chinese. The second one is what goes on the resume — it speaks finance, it speaks Chinese, and it is short enough to finish in a week.

Week one is environmental setup plus the two non-negotiable videos: 3Blue1Brown on attention and Karpathy on "Let's build GPT". These two videos, watched in full, will save you weeks later. Everything else flows from the mental model they install.

Weeks two and three are tokenization, embedding, and Hugging Face. You should be able to load a pretrained model, tokenize a batch of Chinese financial text, fine-tune on a small labeled set, and save the resulting checkpoint by the end of week three. Week four is the Chinese earnings-call project, plus a short retrospective that updates your progress tracker in Obsidian.

Month 2 — Transformer + LLM

This is the spine of the entire curriculum. If you skip Month 2, Month 3 and Month 4 will collapse. Spend the time here.

The reading list is short but non-negotiable:

The capstone is a hand-written mini GPT. About a hundred lines of PyTorch. Trains on Tiny Shakespeare in a few minutes on a single GPU. The point is not the model — the point is that you can stand at a whiteboard and rebuild the architecture from memory. Interviewers will ask you to.

By the end of Month 2 you should also be fluent in the five prompt patterns: zero-shot, few-shot, chain-of-thought, ReAct, and function calling. The latter is especially important because it is the bridge to Month 4's agents.

Month 3 — RAG + vector databases

RAG is the default enterprise GenAI pattern, and RAGAS-style evaluation is the language of quality in this stack. You have a complete five-note research set already in your Obsidian vault — use it.

The capstone project is a finance RAG system over ten annual reports, with LangChain as the orchestration layer, Chroma as the vector store, Cohere for re-ranking, and RAGAS producing the four core metrics. A passing build scores above 0.9 on faithfulness. Wire the evaluation into a GitHub Action so every pull request is checked.

The pipeline, in code

from langchain.document_loaders import DirectoryLoader, PyPDFLoader
from langchain.text_splitter import RecursiveCharacterTextSplitter
from langchain.embeddings import OpenAIEmbeddings
from langchain.vectorstores import Chroma
from langchain.chat_models import init_chat_model
from langchain.prompts import ChatPromptTemplate
from langchain_core.runnables import RunnablePassthrough
from langchain_core.output_parsers import StrOutputParser

loader = DirectoryLoader("./data/annual_reports",
    glob="*.pdf", loader_cls=PyPDFLoader)
documents = loader.load()

splitter = RecursiveCharacterTextSplitter(
    chunk_size=1000, chunk_overlap=200,
    separators=["\n\n", "\n", "。", " ", ""])
chunks = splitter.split_documents(documents)

embeddings = OpenAIEmbeddings(model="text-embedding-3-large")
vectorstore = Chroma.from_documents(
    chunks, embeddings, persist_directory="./chroma_db")

retriever = vectorstore.as_retriever(search_kwargs={"k": 4})

template = """Answer based only on context. Context: {context}
Question: {question}
Answer:"""
prompt = ChatPromptTemplate.from_template(template)

llm = init_chat_model("gpt-4o", model_provider="openai")

chain = ({"context": retriever, "question": RunnablePassthrough()}
         | prompt | llm | StrOutputParser())

print(chain.invoke("What is Moutai's 2024 net profit?"))

The four RAGAS metrics you must know

MetricWhat it measures
FaithfulnessDoes the answer stay inside the retrieved context?
Answer relevancyIs the answer actually responsive to the question?
Context precisionIs the retrieved context the right slice?
Context recallDid we retrieve everything the answer needed?

Month 4 — Agents + multi-modal

LangGraph 1.0 is the standard. The capstone is a four-agent financial analyst built on it: a SQL agent that translates questions into queries, an executor that runs them, an analyzer that interprets the rows, and a chart agent that renders a matplotlib figure. The graph wires them in sequence, with a MemorySaver checkpoint so multi-turn analysis works.

The two LangGraph features you must demonstrate are persistence (multi-turn conversation) and human-in-the-loop (the agent pauses before destructive operations like writing to a database). Both show up in production systems and both are easy interview questions.

Month 5 — Capstone projects

Three repositories. Each one is its own repo, each has a polished README, each one runs end-to-end. They are the three things on your resume.

  1. finance-rag-system — the Month 3 project, hardened, with a Streamlit UI and a passing RAGAS report.
  2. finance-multi-agent — the Month 4 project, with real data, real charts, and a deployed demo.
  3. finance-llm-finetune — a LoRA fine-tune of Qwen-7B on financial reports, demonstrating a measurable lift over the base model.

Each README should lead with what the system does in one sentence, then the architecture diagram, then how to run it, then the evaluation result. No one reads more than the first paragraph before deciding whether to look further.

Month 6 — Search and interview

Five coding problems you can write from memory:

  1. Self-attention in PyTorch
  2. Multi-head attention in PyTorch
  3. A Transformer encoder block
  4. An RAG pipeline, end to end
  5. LoRA fine-tuning: what is frozen, what is trained, why it works

Three project walkthroughs, each five minutes long, with one number per project that you can defend (RAG faithfulness score, agent latency, fine-tune accuracy lift).

Send fifty applications over ten working days. Mix the categories: ten to fintech firms (your best fit), ten to AI-native startups (most hiring), five to large internet companies (long shot, worth one attempt), five to multinationals (English interview), and twenty to mid-size firms where the role title is closest to GenAI data scientist.

The eight standards hiring managers actually check

StandardStatus going inAfter this curriculum
Python + SQLHave itHave it
Classical MLHave itHave it
PyTorch depthPatch itHave it
Transformer architectureDon't have itHave it
LLM APIs and prompt engineeringDon't have itHave it
RAG + vector databasesDon't have itHave it
LangChain / LlamaIndexDon't have itHave it
Agent + LangGraphDon't have itHave it

Why this is the shortcut

A GenAI data scientist is the intersection of three things: classical data science, LLM application engineering, and business fluency. You already have two of the three. The six months ahead are just closing the third. Once you do, your six-plus years of finance and BI experience stops being a side note on your resume and becomes the reason you get the offer.

Three takeaways

Sources

Hugging Face NLP Course. Andrej Karpathy, "Let's build GPT", YouTube. 3Blue1Brown, "Attention is Transformers", YouTube. LangChain 1.0 and LangGraph 1.0 documentation. DeepLearning.AI short courses on LangChain and LangGraph. Anthropic prompt engineering documentation. The RAG research set already in the Obsidian vault under Finance / _AI-Strategy / RAG-框架.