Anyone can put Playwright on a CV, so for this role the vetting is built around writing tests. Company-wide, 80%+ of our engineers, testers included, are senior-level or above, and some of our testers are ISTQB-certified.
Automated QA ran on a Dutch eHealth provider's patient portal and on the fair lending platform of a UK fintech startup. On the training module we built into a compliance software platform, realistic customer data wasn't available, so we wrote its automated integration and end-to-end tests to run on synthetic data.
What the steps test
Every candidate goes through three steps before your shortlist. The technical skills assessment tests the languages and test frameworks they claim, at the seniority they claim. The soft-skills evaluation covers English, teamwork and how they take feedback, and the job-history analysis is our check of the CV. For this role a live coding interview comes on top, where the candidate writes code in real time and talks through it. A background check is added only when a client asks for one.
The automation task
In the practical part of the assessment, the candidate automates a given flow against a sample app or API and wires the suite into CI. We judge how that wiring is done, whether the selectors hold steady, how the suite is structured and what the candidate does with a step that fails at random.
Who interviews whom
Under staff augmentation you interview every candidate before anyone starts, and you can turn one down on the CV or on the interview. Our technical interview and live coding can also be part of your own selection, with full visibility for you. If you would rather not interview every engineer, we can set up and vet a managed QA automation team, and you interview the key roles.