by Exam Director Sarah Bridegroom
Overall exam activity in 2019 was lively: over 1200 exams were administered: 85% beer, 6 % written, 7% mead, 2% cider. Approximately 1000 people earned a passing certificate for the entrance exam: 9% for mead, 5 % for cider, and the remainder for beer. Exam growth continues in several regions including Latin America, Europe and Asia.
Notable events of 2019 include the beginning of the cider program, generating both new cider judges and qualified proctors. [hyperlink] Also progressing last year were upgrades to grader forms and communication tools, and improved data collection for exam administration.
We welcomed both new graders and new language providers into the program throughout 2019. The grader group has worked collaboratively by providing insight into grading procedures, and helping new graders become proficient in exam evaluation.
While exam data similar to that above are often of interest, there are other, lesser- known data and trends that affect the program. That can include trends that generate concern or warrant extra attention. The Exam Directorate has identified salient examples below. These scenarios do not apply to all areas or all exams, but apply often enough to take notice and to identify as areas of needed improvement.
Proctor Participation
Obtaining appropriate qualified proctors is part of the exam-planning process. For exam administrators, this means identifying and obtaining commitments from qualified proctors before submitting an application for an exam. For the qualified judges, it means making yourself available and accepting invitations to proctor. Qualified proctor participation is evaluated during application review.
Exam Attendance
A notable number of exams this past year were not full. In some cases, attendance numbers fell below the minimum number of examinees. When applying to host an exam and throughout exam planning, please perform due diligence in not only evaluating demand but also successfully filling available seats.
Exam Administrator Performance
It is crucial that exam administrators follow BJCP protocols. These protocols are designed to maintain the quality of the exams (qualified proctors, good beverage planning), efficient scheduling, grading and reporting (timely and complete submission of exam data, correct file formatting, obtaining required ED approvals) and fair access to potential examinees (non-exclusionary registration practices). Also, as the program has expanded outside of the US, financial pressures are more pronounced. Follow BJCP guidelines with respect to spending, ED approvals, and requests for reimbursements. Failure to adhere to BJCP policy and procedure places a site’s future exams at risk.
Data Confidentiality
Exam data is considered confidential data. Any judge that acts on behalf of the BJCP is expected to treat it as such. Whether examinee, proctor, or grading data, the BJCP expects that data custodians are respectful of not only governing policies, but also your BJCP colleagues’ right to confidentiality and parity.
Social Media
Be mindful of not only others’ personal boundaries but also data confidentiality when creating or commenting on exam-related content on social media platforms. Items that jeopardize either a judge’s anonymity or data can have unintended, negative impact.
Throughout 2020, we’ll continue our focus on various policies and procedures that govern the program. Objectives for 2020 include:
- Provide follow up information steps for exam administrators;
- Work with the Board of Directors to improve protocols governing proctor-related reimbursements;
- Evaluate growth strategies for the exam program;
- Upgrade standardized forms and exam program documents; and
- Support process automation goals.
The Exam Directorate and exam participants appreciate the volunteer time and expertise that our judges lend in support and growth of the exam program. Thank you to all exam volunteers that participated last year and those that are continuing service in 2020. Thank you as well to the members of the Exam Directorate. It takes a lot of time and accountability to make successful programs. Best wishes to all for a prosperous and productive year.