Medical Scientific Annotation Specialist

<h2><strong>Overview</strong></h2>
<p><span data-contrast="auto">Black Canyon Consulting (BCC) is seeking highly qualified Medical Scientific Annotation Specialists to support a critical NIH research initiative focused on modeling sepsis progression using multimodal clinical data from MIMIC-IV.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p><span data-contrast="auto">This role will support the development of a high-quality annotated clinical reference set by reviewing and refining clinical events and their timing within patient records. Annotators will work with clinical notes and, where applicable, structured electronic health record (EHR) data to determine when clinically meaningful events occurred and assess the certainty of those timestamps.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p><span data-contrast="auto">The project will also evaluate the use of large language models (LLMs) to assist with clinical annotation. Ideal candidates will have a strong clinical background, experience interpreting complex patient records, and familiarity with sepsis and critical care.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<h3><strong><span data-contrast="auto"><span data-ccp-parastyle="heading 2">Purpose</span></span></strong><span data-ccp-props="{"134233117":false,"134233118":false,"134245418":true,"134245529":true,"335559738":299,"335559739":299}"> </span></h3>
<p><span data-contrast="auto">The primary aim of this project is to improve the temporal characterization of sepsis progression by creating a certainty-aware annotated reference set that can be used to evaluate unimodal and multimodal approaches to clinical timeline construction.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p><span data-contrast="auto">Annotators will help identify and validate clinically meaningful events, determine their timing, distinguish certain from uncertain timestamps, and assess the clinical evidence supporting event timing.</span></p>
<h3><strong>Roles & Responsibilities</strong></h3>
<ul>
<li>
<p><strong><span data-contrast="auto"><span data-ccp-parastyle="heading 3">Training & Onboarding</span></span></strong><span data-ccp-props="{"134233117":false,"134233118":false,"134245418":true,"134245529":true,"335559738":281,"335559739":281}"> </span></p>
<p><span data-contrast="auto">Participate in remote project training and onboarding, including:</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<ul>
<li data-leveltext="" data-font="Symbol" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1"><span data-contrast="auto">Annotation guidelines and protocols.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></li>
</ul>
<ul>
<li data-leveltext="" data-font="Symbol" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="2" data-aria-level="1"><span data-contrast="auto">Clinical event and timestamp annotation procedures.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></li>
</ul>
<ul>
<li data-leveltext="" data-font="Symbol" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="3" data-aria-level="1"><span data-contrast="auto">Use of the project's annotation and visualization tools.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></li>
</ul>
<ul>
<li data-leveltext="" data-font="Symbol" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="4" data-aria-level="1"><span data-contrast="auto">Required CITI training and secure environment access.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></li>
</ul>
<ul>
<li data-leveltext="" data-font="Symbol" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="5" data-aria-level="1"><span data-contrast="auto">Calibration exercises prior to production annotation.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></li>
</ul>
<p> </p>
</li>
<li>
<p><strong><span data-contrast="auto"><span data-ccp-parastyle="heading 3">Clinical Annotation</span></span></strong><span data-ccp-props="{"134233117":false,"134233118":false,"134245418":true,"134245529":true,"335559738":281,"335559739":281}"> </span></p>
<p> </p>
<ul>
<li>
<p><span data-contrast="auto">Review clinical documentation from patients with sepsis and identify clinically meaningful events related to disease progression and patient care.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
</li>
<li>
<p> </p>
<p> </p>
<p><span data-contrast="auto">Review and correct draft events and candidate timestamps generated through the project's annotation workflow.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p> </p>
</li>
<li>
<p><span data-contrast="auto">Apply the project's defined event schema consistently across assigned records.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p> </p>
</li>
</ul>
</li>
<li>
<p><strong><span data-contrast="auto"><span data-ccp-parastyle="heading 3">Temporal Event Validation</span></span></strong><span data-ccp-props="{"134233117":false,"134233118":false,"134245418":true,"134245529":true,"335559738":281,"335559739":281}"> </span></p>
<p> </p>
<ul>
<li>
<p><span data-contrast="auto">Determine when clinical events occurred based on available documentation.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p> </p>
</li>
<li>
<p><span data-contrast="auto">Classify timestamps as certain when supported by an explicit time or unambiguous temporal anchor.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p> </p>
</li>
<li>
<p><span data-contrast="auto">Identify uncertain timestamps when timing must be inferred from clinical context, judgment, or supporting structured data.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p> </p>
</li>
<li>
<p><span data-contrast="auto">Resolve temporal expressions such as "overnight," "earlier today," or "worsening over several hours" using available evidence.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p> </p>
</li>
</ul>
</li>
<li>
<p><strong><span data-contrast="auto"><span data-ccp-parastyle="heading 3">Multimodal Clinical Review</span></span></strong><span data-ccp-props="{"134233117":false,"134233118":false,"134245418":true,"134245529":true,"335559738":281,"335559739":281}"> </span></p>
<p> </p>
<ul>
<li>
<p><span data-contrast="auto">Review structured EHR information, when provided, to support or refine the timing of events described in clinical notes.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p> </p>
</li>
<li>
<p><span data-contrast="auto">Evaluate relevant clinical signals such as vital signs, laboratory trends, interventions, vasopressor initiation or escalation, urine output, ventilator settings, and other indicators of patient deterioration.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p> </p>
</li>
<li>
<p><span data-contrast="auto">Document whether timing evidence is supported by notes only, structured data only, or a combination of notes and structured data.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p> </p>
</li>
</ul>
</li>
<li>
<p><strong><span data-contrast="auto"><span data-ccp-parastyle="heading 3">Quality Control & Adjudication</span></span></strong><span data-ccp-props="{"134233117":false,"134233118":false,"134245418":true,"134245529":true,"335559738":281,"335559739":281}"> </span></p>
<p> </p>
<ul>
<li>
<p><span data-contrast="auto">Participate in pilot calibration and double-annotation activities.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p> </p>
</li>
<li>
<p><span data-contrast="auto">Review annotation disagreements and participate in adjudication as needed.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p> </p>
</li>
<li>
<p><span data-contrast="auto">Follow versioned annotation guidelines and incorporate updates resulting from calibration and adjudication.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p> </p>
</li>
<li>
<p><span data-contrast="auto">Maintain consistent annotation quality across production batches.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p> </p>
</li>
<li>
<p><span data-contrast="auto">Support targeted quality assurance for uncertain timestamps, discrepancies between narrative and structured data, and high-risk clinical transitions.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p> </p>
</li>
</ul>
</li>
<li>
<p><strong><span data-contrast="auto"><span data-ccp-parastyle="heading 3">Communication</span></span></strong><span data-ccp-props="{"134233117":false,"134233118":false,"134245418":true,"134245529":true,"335559738":281,"335559739":281}"> </span></p>
<p> </p>
<ul>
<li>
<p><span data-contrast="auto">Participate in regular project meetings and annotation discussions.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p> </p>
</li>
<li>
<p><span data-contrast="auto">Raise ambiguous cases or guideline questions for team review.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p> </p>
</li>
<li>
<p><span data-contrast="auto">Incorporate feedback and guideline updates throughout the annotation effort.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
<p> </p>
</li>
<li>
<p><span data-contrast="auto">Collaborate with other annotators and project team members to maintain consistency across the reference dataset.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p>
</li>
</ul>
</li>
</ul>
<h3><strong><span data-contrast="auto"><span data-ccp-parastyle="heading 2">Required Skills</span></span></strong><span data-ccp-props="{"134233117":false,"134233118":false,"134245418":true,"134245529":true,"335559738":299,"335559739":299}"> </span></h3>
<ul>
<li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1"><span data-contrast="auto">Clinical training and demonstrated ability to interpret complex patient records.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></li>
<li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1"><span data-contrast="auto">Familiarity with sepsis, acute organ dysfunction, and clinical deterioration.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></li>
<li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1"><span data-contrast="auto">Ability to interpret clinical notes, vital signs, laboratory results, interventions, and other EHR information.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></li>
<li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1"><span data-contrast="auto">Strong clinical reasoning and attention to detail.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></li>
<li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1"><span data-contrast="auto">Ability to interpret temporal information within clinical documentation.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></li>
<li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1"><span data-contrast="auto">Ability to consistently apply detailed annotation guidelines.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></li>
<li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1"><span data-contrast="auto">Comfort working with digital annotation tools and structured clinical data.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></li>
<li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1"><span data-contrast="auto">Ability to work independently and collaboratively in a distributed team environment.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></li>
</ul>
<h3><strong><span data-contrast="auto"><span data-ccp-parastyle="heading 2">Education & Experience</span></span></strong><span data-ccp-props="{"134233117":false,"134233118":false,"134245418":true,"134245529":true,"335559738":299,"335559739":299}"> </span></h3>
<h4><strong><span data-contrast="auto"><span data-ccp-parastyle="heading 3">Required</span></span></strong><span data-ccp-props="{"134233117":false,"134233118":false,"134245418":true,"134245529":true,"335559738":281,"335559739":281}"> </span></h4>
<ul>
<li data-leveltext="" data-font="Symbol" data-listid="3" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1"><span data-contrast="auto">Advanced degree or professional certification in a clinical field, such as MD, DO, PA, NP, or RN with relevant clinical experience.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></li>
<li data-leveltext="" data-font="Symbol" data-listid="3" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1"><span data-contrast="auto">Experience reviewing and interpreting clinical documentation and patient records.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></li>
</ul>
<p> </p>
<h3 id="StandardFullstackdeveloperpositiondescriptionSenior-Requiredskillsandexperience">Benefits and Salary</h3>
<p>We attract the best people in the business with our competitive benefits package that includes medical, dental and vision coverage, 401k plan with employer contribution, paid holidays, vacation, and tuition reimbursement.</p>
<p>We offer a competitive salary commensurate with experience and location.</p>
<p>If you enjoy being a part of a high performing, professional service and technology focused organization, please apply today!</p>