11. Platform console (Kombee staff)

For Kombee staff only: every company on SetBenchmark.

On this page:

Library review: approve AI-written library questions

Click “Library review” in the console. It lists the AI-written library questions no person has checked yet, with how many are waiting and how many have been reviewed. Each shows its skills, level, the question and its answer (the right options are ticked; for coding and other kinds, open “Tests, answer and settings”), and how many tests already use it.

Click “Approve” if the question is right and fair: companies can then put it into tests. Click “Retire” if it is wrong or not worth fixing: it leaves the library. Until a question is approved, companies can read and copy it but not use it in a test, so no AI-written question reaches a candidate without a person reading it first.

How to do it:

  1. Open the console and click “Library review”.
  2. Read the question and its answer.
  3. Click “Approve” or “Retire”.

Costs: daily cost report per company and per candidate

Click “Costs” in the console. It shows what SetBenchmark cost Kombee to run yesterday and this month, per company, split into AI, sandbox (code runs), interviews and other; the average cost of one candidate this month for each kind of assessment (test, test with a lab, AI interview, live interview); and the recordings, spoken answers and evidence pictures stored for each company.

AI costs are exact (from each AI call’s logged cost). Sandbox and video time are estimates, from the sandbox server’s monthly price and the video service’s price per minute; the rates are at the bottom of the page.

The same summary is emailed to Kombee’s staff every morning (about 8:30 in India) for the day before.

“Fallback lines shown to candidates” counts how often an AI interview candidate got one of the four fixed, pre-approved questions instead of the AI’s own: when the safety check refused the AI’s question, gave no clear answer twice, or the AI couldn’t be reached (an outage or a spending cap). A candidate never sees a blank turn. The morning email gives the count too.

Daily AI cap per company

Every company has a daily cap on its AI spending, so one bad day can’t use a month’s budget. Unless Kombee sets one, the default applies (₹1,000 a day). Days start at midnight UTC (5:30 in India).

Open the company in the console. “Daily AI cap” shows today’s AI spending against the cap. Type a new amount in rupees and click “Save daily cap”, or leave it empty and save to go back to the default.

At 80% and at 100% the company’s admins and Kombee’s staff get an email. At the cap, new AI work (marking suggestions, question writing, reports) waits until the next day. An AI interview or test assistant a candidate is already using carries on, up to half as much again, so nobody is cut off mid-answer; if even that runs out, the candidate gets a fixed question instead of a blank turn.

Growth: where new companies come from

Click “Growth” in the console. It shows the companies created in the last 90 days and how far they got: made a test, published one, invited a candidate, got a first result, and the typical time from signing up to the first test. These numbers come from SetBenchmark’s own records, so they count every company, whether or not its people accepted cookies.

“Self-serve sign-ups by source” shows where companies that signed up on the website came from: the campaign tags on the link they first arrived by (utm_source, utm_medium, utm_campaign), else the website that sent them, else “direct”. This is known only when the visitor allowed analytics cookies, or arrived on the sign-up page with the tags. “Campaigns” and “Sign-ups per week” break it down further.

At the bottom, “Google Tag Manager for the public website” holds the container ID (like GTM-ABC1234) that Kombee’s marketing team set up with Google Analytics inside it. Paste it and click Save: the website picks it up within a minute, no deploy. Leave it empty and save to switch website analytics off.

How to do it:

  1. Create a Tag Manager web container and a GA4 property, and add the GA4 tags in the container (docs/analytics/plan.md lists the events).
  2. Publish the container in Tag Manager.
  3. Open the console, click “Growth”, paste the container ID and click Save.

Tip: Tag every link you share with utm_source, utm_medium and utm_campaign (lower-case, for example utm_source=linkedin&utm_medium=cpc&utm_campaign=q1-hiring) so sign-ups show under the right campaign.

Tip: Google Analytics only sees visitors who accept cookies, so its numbers are lower than the console’s.

Cookies on the public website

SetBenchmark’s own public pages (home, pricing, sign-up, sign-in and the legal pages) ask visitors about cookies the first time they come. “Accept all”, “Reject all” and “Choose” are side by side; the website works the same whichever you pick. Nothing from Google loads until you agree.

Analytics cookies count visits and pages (Google Analytics) and remember for 30 days which campaign or website brought you, so Kombee can see which ones lead to sign-ups. Marketing cookies show whether an ad led to a visit. Neither holds your name or email.

To change your mind, click “Cookie settings” at the bottom of any of these pages. Withdrawing removes the cookies. Company sites, the candidate site, tests, interviews and the console never use analytics or marketing cookies.

Credit packs and giving credits

Open “Plans” to change credit pack prices in each currency (before tax), or take a pack off sale. Packs show on the public pricing page at /pricing and in companies’ Settings → Billing. The prices there now are samples until the price list is approved.

Open a company and use “Give credits” for a deal or pilot: the number of credits and a reason. A company not on a paid plan then needs credits to start tests.

For credit payments to arrive, tick the “payment_link.paid” event on the webhook in the Razorpay dashboard.

Revenue by region and plan

Click “Revenue” in the console. It shows credits sold, given, used, given back and expired over the last 12 months, then credit pack and plan revenue by region, before tax. Each currency stays separate, so nothing is added across currencies.

Once a day SetBenchmark also checks orders still waiting for payment against Razorpay. A paid order whose confirmation never arrived gets its credits, and any wallet that doesn’t match its ledger is written to the server log.

Platform console (Kombee staff): Revenue by region and plan
Click the picture to open it full size.

Sandbox use

Click “Sandbox use” in the console to see code runs per company over the last 30 days. Each run gets its own sandbox, which is destroyed when the run ends, so nothing is left running. A few sandboxes are started ahead of time for tests being taken or opening within half an hour, so a run starts at once; each is still used for one run only. Cost shows only what was recorded per run; the sandbox server itself is a fixed monthly cost.

Platform console (Kombee staff): Sandbox use
Click the picture to open it full size.

Plan prices in other currencies

In the console, open “Plans”, then “What companies see” on a plan. Under “Price on the public page, in other currencies”, type the price in AED, SAR, AUD, NZD and USD and click “Save”. A currency left empty shows “Ask us” on the pricing page. Prices are placeholders until Kombee approves the price list.

The pricing page opens in the visitor’s likely currency, worked out from their country or browser language, and they can always switch.

Companies

Add a company, see its plan and usage, suspend it, export or remove its data. Support access works only while the company allows it.

The Subdomain is the company’s own web address, such as acme-labs. It fills in from the company name, and you can change it before saving. A few names are kept for SetBenchmark’s own addresses (such as api, take, www, custom and console), so they can’t be used. The admin gets an invitation email with a sign-in link as soon as you add the company.

When you add a company, tick the modules it may use (all are ticked to start with). Its addresses work straight away, with nothing to set up on the server. On a company’s page, “Modules” switches modules on or off at once; putting it on a plan, or changing its plan, sets them from the plan again.

Platform console (Kombee staff): Companies
Click the picture to open it full size.

Plans

Plans, prices, coupons and each company’s subscription and invoices. Everything here is up to Kombee: no plan, price or limit is fixed in the software.

“Add the suggested plans” adds four to start from: Free (₹0: tests and basic monitoring, 10 tests a month), Silver (₹4,999 a month: adds video interviews and AI help with questions), Gold (₹14,999: adds AI interviews, employee skills and SMS or WhatsApp) and Platinum (₹39,999: everything, including API access and single sign-on). Prices are before GST. Change any of them, or make your own.

Each plan has “What companies see”: its name, description, place in the list and whether companies are offered it. A plan not offered can still be given to a company from its page in the console, for example for a special deal. Prices, modules and monthly allowances change by publishing a new version; companies already on the plan keep their version until moved.

A price of 0 makes a free plan. It never goes to Razorpay. When a paid plan or the free trial ends, the company moves to the first free plan offered. For each monthly allowance you can set an extra rate: with a rate, work carries on past the allowance and the extra is invoiced; without one, work stops at the allowance.

Tip: Switch on Razorpay first (Services → Payments, with the key ID, key secret and webhook secret), so companies can pay. In the Razorpay dashboard, add a webhook to https://api.<main site>/webhooks/razorpay (the api. address: the main address redirects, and Razorpay does not follow redirects) with the subscription and payment events.

Tip: Changing to another Razorpay account (for example from test keys to live keys) is fine: each plan is set up in the new account the first time a company chooses it.

Platform console (Kombee staff): Plans
Click the picture to open it full size.

Practice problems and moderation

Open “Practice” to run the public practice area. The numbers at the top are practice’s own meter: code runs today against the daily ceiling, visitors today, and runs this month. Practice never uses a company’s allowance.

“Discussion waiting for a decision” lists new posts: click “Approve” to show one under its problem, or “Reject” (for full solutions, spam or anything rude).

Click “Add a problem”, or a problem’s title to edit it. For code, give each test the exact input and the exact output; tick “Example” for those to show (at least one), and keep at least one hidden. For multiple choice, put one answer per line and choose the right one; the write-up is shown as the explanation. New problems stay hidden until you click “Publish”; “Hide” takes one off the catalogue but keeps everyone’s progress.

Platform console (Kombee staff): Practice problems and moderation
Click the picture to open it full size.

Services and AI models

Which outside services (email, video, AI) are used, and which AI models. “Stand-in (mock)” means nothing really leaves SetBenchmark: emails, for example, are kept for testing and never reach anyone.

The same works for every service: SMS and WhatsApp (MSG91 for SMS, Gupshup for WhatsApp, or both), payments (Razorpay), speech for voice interviews (Deepgram), video interviews (LiveKit Cloud) and the AI interviewer avatar (Tavus). Each asks for its own keys; SMS and WhatsApp also need a message template approved with the provider.

To send real email, open “Switch provider” under Email and choose Amazon SES, Resend, Mailjet or SMTP. Fill in its key and the From address (on a domain you have verified with that provider), then “Switch now”. It takes effect at once, without a restart. Keys go to the secret store and never show again.

AI interviewer avatar: choose Tavus, paste Kombee’s Tavus key and the Face ID of the face to show, and set the longest interview in minutes (45 when blank). Leave PAL ID blank and press “Check”: an echo PAL is made and its id shown; paste it into PAL ID and click “Save settings”, so the same one is reused. Kombee’s Tavus account pays per minute; each room ends by itself at the limit, and minutes show under each company’s usage as interview minutes. Keep the limit within the longest conversation your Tavus plan allows (Builder: 15 minutes). If an interview runs past it, the face goes away and the rest of the questions are read aloud.

To change a setting of the provider that is on (a new key, a PAL ID, a limit), open “Switch provider”: it is listed first, marked “(on now)”, with its settings filled in. Change what you need and click “Save settings”. A key left blank keeps the one saved.

“Check” under Email sends a test email to you, or to the address you type in the box. If it fails, the message says why (for example, the domain isn’t verified yet). Every switch and check is listed under “History”.

Tip: Emails not reaching candidates or staff? Check that Email isn’t on the stand-in, then use “Check”.

Tip: Amazon SES needs an access key on Google Cloud servers; leave the key blank on AWS servers, which use their own role.

Tip: No email domain of your own yet? Choose SMTP and use a Gmail account: Server smtp.gmail.com, Port 465, Username the Gmail address, Password a 16-letter app password (Google account → Security → 2-Step Verification on → App passwords), From address the same Gmail address. Gmail sends about 500 emails a day, so use it for demos and small volumes. Microsoft 365 (smtp.office365.com, port 587) and Zoho work the same way.

Platform console (Kombee staff): Services and AI models
Click the picture to open it full size.

Incidents

Code the sandbox stopped, across every company.

Platform console (Kombee staff): Incidents
Click the picture to open it full size.

Support and status

Answer companies’ questions, and post notices on the public status page, such as planned maintenance.

Platform console (Kombee staff): Support and status
Click the picture to open it full size.