AI Survey Analysis in India: How the Poseidon Engine Works

How AI survey analysis works on Hercules: SQL does the maths, three checks verify it, plus the formulas, a question bank and what it cannot do.

In shortAI survey analysis on Hercules Works is done by Poseidon. It reads the structure of a completed survey and drafts SQL for your plain-language question. The numbers are computed by SQL on the response data, not by the language model, and a claim verifier recomputes the statistics it can extract. An output validator and a self-critique check the rest. It supports analysts rather than replacing them.

AI Survey Analysis in India: How the Poseidon Engine Works
Contents

The Problem With Asking an AI to Analyse a Spreadsheet

Most tools that promise AI survey analysis hand your data to a language model and ask it to find insights. Language models are good at writing and unreliable at arithmetic. A fluent summary can carry one wrong percentage, and a hurried reader will not catch it.

Poseidon is the analytics engine inside Hercules Works, and it is built around that problem. It works out what each question in your survey is first, picks a named formula for that question type, has the model draft the query, runs it as SQL on the data, and only then asks the model to write the explanation. This page explains each stage, lists the formulas, gives you a bank of questions to ask, and states what the engine does not do. We make this product, so read it as a vendor's account. Where you can test a claim yourself, we say how.

From Completed Survey to Answer: The Stages

Analysis starts when a study is marked complete. Responses are collected through the SuperJ app, and the engine ingests them once the survey ends.

StageWhat happens
1. IngestResponses are pulled in and stored as Parquet, a columnar file format that a SQL engine can scan quickly
2. Typed survey modelThe engine records each question, its type, the routing and the demographic fields, so it knows an NPS item from a multi-select
3. Your questionYou type a question in plain language. Off-topic questions are refused rather than guessed at
4. Method choiceCode, not the language model, maps the question type to a formula
5. SQL on ParquetDuckDB runs the formula directly on the response file
6. VerificationThree checks run on the numbers and the wording (below). Simple look-ups, such as previews, row counts and value counts, take a fast path that skips them
7. Narrative and confidenceThe model writes the explanation, a confidence score is attached, and follow-up questions are suggested

The typed model is why routing matters. If only smokers saw question 12, the base for question 12 is smokers, and the engine knows that from the survey structure. A generic tool reading a CSV does not.

Why the Language Model Does Not Do the Maths

Every number in an answer comes from a SQL query, not from model text. The model drafts the query and the wording. To do that it is given column names and types, summary statistics computed in SQL, and up to 10 sample rows. It is not given the full response table, but those sample rows are real responses, so ask us whether free-text answers can appear in them and what the model provider's data terms are.

Three details show what that means in practice:

  • Multi-select questions. Answers are stored as one cell such as "A;B;C". The engine splits them so counts are selections, and it uses respondents as the denominator for percentages. Mixing the two is a common error in hand-built tables.
  • "Don't know" codes. Codes such as 98 or 99 are set to null on rating and NPS columns, so they do not drag a mean down.
  • Checked column names. Before a query runs, every column it names is checked against the real schema. A wrong name is refused with a suggestion, not guessed.

Only the result goes back to the model. This separation is what makes the checks below possible, because a number from SQL can be recomputed and a number from text cannot.

Three Verification Layers and a Confidence Score

LayerWhat it does
Claim verifierExtracts statistics quoted in the answer (means, counts, percentages, correlations, NPS) by pattern matching and recomputes them with a fresh SQL query, up to a cap of 20 claims. It uses no language model. A large mismatch on several claims can trigger one regeneration
Output validatorChecks structure: empty output, error text in the result, and whether a chart came back
Self-critiqueSanity-checks ranges (a percentage cannot exceed 100, NPS must sit between -100 and 100, breakdowns should sum to about 100) and then audits the narrative for unsupported claims, contradictions, causal wording on correlational data and missing base sizes

Each answer also carries a confidence score, shown as a low, medium or high badge. It combines the verification results with how well the answer matches your question, the statistical power, the data quality and whether execution succeeded. Treat it as a prompt to look harder, not as a guarantee.

We publish no accuracy percentage for these checks, and you should distrust any vendor who does without a method and test data. Run your own test: ask for five numbers and recompute them from the export.

Formulas by Question Type

The formula is chosen by question type. These are the ones we can state precisely:

AnalysisWhat it computes
NPS% scoring 9-10 minus % scoring 0-6 on a 0-10 scale
Top-2-boxShare of answers in the top two points of a scale
Borda countFor n options, a rank 1 earns n points, rank 2 earns n-1, and so on. Points are summed, with mean rank and first-choice share alongside
MaxDiff utilities(best - worst) / (best + worst) per item, scaled 0-100
TURFGreedy search for the set of items that reaches the most respondents
Driver analysisLogistic regression with Shapley importance; Pratt's relative importance as a fallback
SegmentationK-means on standardised items with silhouette scores to pick the number of segments; CHAID-style splits for tree segments
Penalty analysis (JAR)(liking when Just About Right - liking when not) x share not Just About Right
FunnelStage counts, conversion from the previous stage and end-to-end yield
Importance-performanceGap = importance - performance, sorted into four quadrants
WeightingEffective sample size = (sum of weights)^2 / sum of squared weights

Its formula library also lists chi-square, t-tests, ANOVA, non-parametric tests and confidence intervals. For when each test applies, see our significance testing guide. For the design side of MaxDiff and Kano, see those guides.

Example Questions You Can Ask

Ask for a cut, a base and a method in the same sentence. Our bank, by job:

JobQuestion to typeWhat runs
Loyalty"What is NPS by city tier, and how big is each base?"NPS by group, with bases
Concept screening"Top-2-box purchase intent for each concept, split by NCCS"Top-2-box cross-tab
Claims"Rank the six claims by Borda score and show first-choice share"Borda count
Features"Which features have the highest MaxDiff utility, and which three reach the most people?"MaxDiff, then TURF
Satisfaction"What drives overall satisfaction most?"Driver analysis
Segments"Are there distinct groups in the attitude battery? Describe each"Segmentation
Product test"Which attribute loses the most liking when it is not Just About Right?"Penalty analysis
Brand funnel"Where do we lose people between awareness and purchase?"Funnel conversion
Priorities"Which attributes are important but rated poorly?"Importance-performance gap
Data check"How many respondents answered Q9, and how many were routed past it?"Count with base
Quality"Which results rest on small bases?"Base-size flags

Then ask the follow-up the engine suggests, and one more of your own: "Is that difference statistically significant, and what is the smallest group in this comparison?"

The Report: Planned Around Your Goal

When the study is complete and its data is ready, a multi-stage report pipeline can write a full report. Your research brief steers it. The stages plan the sections, plan the analyses, run them, group open-ended answers into themes, draw charts, write insights, then audit the draft for consistency and safety before finalising.

A report follows a fixed order: executive summary, methodology, a section for each goal, data quality, respondent profile, question findings, cross-question analysis, derived analytics, themes, recommendations, conclusions and an appendix last. The drafting rule is that each paragraph says what the finding means for the decision, then gives the evidence. You can download the report as Markdown, HTML or PDF. Our help FAQ also lists Excel and PPTX downloads, which the engine's own documentation does not; treat Markdown, HTML and PDF as the confirmed formats.

Ask for a theme question in the report, such as the themes in open-ended answers on price, and read the raw answers behind each theme. Read the executive summary last. Check the data-quality section first: it flags completeness, outliers and small bases.

What It Does Not Do

  • No Gabor-Granger analysis. You can design a Gabor-Granger study in our survey builder, but Poseidon does not compute the demand curve. Analyse it yourself from the data. See our Gabor-Granger guide.
  • Van Westendorp is a template only. Poseidon has a starting template, not a full executor. Check the price points by hand, as in our Van Westendorp guide.
  • No choice-based conjoint. The survey builder does not offer it either. See conjoint alternatives.
  • It supports analysts, it does not replace them. It does not know your market, and it cannot tell you whether a sample suits your decision. Read the verbatims yourself and decide what to act on.
  • Weighting. The engine can compute effective sample size from weights. Ask whether your study's results are weighted to population targets before you rely on them.
  • Panel limits. Data comes from smartphone users on the SuperJ app, so households without a smartphone are under-represented.

Our public pages do not describe running Poseidon on responses collected elsewhere. Ask first if that is your plan.

Running This Study on Hercules

If your job is a consumer survey in India with automatic analysis, this is a test you can run. Field a short survey in two cities where you already know one answer differs, then check that the cross-tab shows it, every figure in the report matches a table, and the themes fit the raw answers.

StepPlanResponsesPrice per responseCost
Test the questionnaireFree30₹0₹0
Small pilotPlus100₹150₹15,000
Main studyPro400₹120₹48,000

Pro is sold in bundles of 400 to 1,000 responses and costs 20% less per response than Plus. Plus lists an "Advanced analytics engine"; the plan list does not name Poseidon. Whether the Free plan includes Poseidon reports is not described on our public pages, so ask. Enterprise plans come with a dedicated research team and are priced on request. See pricing.

The SuperJ panel has a 25M+ consumer footprint. The verified, survey-eligible panel is a subset, and availability depends on your targeting. Members complete Aadhaar-based KYC once and each study receives a zero-knowledge proof, not identity documents. Surveys run in as many Indian languages as the study needs, and speeders, straight-lining and inconsistent answers are removed before analysis. Details are on the panel methodology page. The limit is the one above: smartphone users only.

Start free with 30 responses

Frequently asked questions

What is AI survey analysis?

It means software that selects a method, runs the calculations and writes up survey results. The safe design keeps the arithmetic in SQL and uses the language model only for wording, then checks every number it quotes.

Does the AI see my raw survey responses?

The language model sees column names, types, summary statistics computed in SQL and up to 10 sample rows, not the full response table. The calculations run on the data file in DuckDB. Ask us whether free-text answers can appear in the sample rows and what the model provider's data terms are.

How do I know the numbers are right?

A claim verifier recomputes the statistics it can extract from an answer, up to a cap, with a fresh SQL query. Simple look-ups skip the verification layers. An output validator and a self-critique then check ranges, base sizes and wording. We publish no accuracy figure, so test it by recomputing five numbers from the export.

Can Poseidon analyse Gabor-Granger or Van Westendorp pricing studies?

Not fully. You can design both in the survey builder, but Poseidon does not run Gabor-Granger, and its Van Westendorp support is a template only. Analyse the price data yourself.

Will it replace a research analyst?

No. It saves the time spent on tables, charts and first drafts. A person still decides whether the sample fits the question, reads the open-ended answers and chooses what to act on.

What can I ask it in plain language?

Ask for a metric, a cut and a base: NPS by city tier, top-2-box by NCCS, MaxDiff utilities, drivers of satisfaction, segments, funnel drop-offs. The question bank above lists eleven jobs.

Which plans include Poseidon?

Likely Plus and Pro: the Plus plan lists an "Advanced analytics engine" and Pro includes everything in Plus, but the plan list does not name Poseidon, so confirm before buying. Plus is ₹150 per response from 100 responses; Pro is ₹120 per response in bundles of 400 to 1,000.

Is my data used to train models?

It depends on the plan. Our terms say Pro (Privacy Mode) content is excluded from training, and that Free plan content may be used for model training with no opt-out. The terms do not mention Plus, so ask in writing before uploading sensitive material on Plus.

Ready to get real consumer insights?

25M+ consumer footprint. Free to start.