{"id":34,"date":"2024-10-22T13:15:32","date_gmt":"2024-10-22T12:15:32","guid":{"rendered":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/?page_id=34"},"modified":"2025-10-09T12:05:08","modified_gmt":"2025-10-09T11:05:08","slug":"dealing-with-uncertainty","status":"publish","type":"page","link":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/dealing-with-uncertainty\/","title":{"rendered":"Dealing with uncertainty"},"content":{"rendered":"\n<p class=\"\">Implementing algorithmic systems involves a lot of uncertainty, be it because of the inherent uncertainty in the results of the systems themselves, due to organisational uncertainty regarding the history and aims of a project, or what sort of issues the organisation might hit once the algorithm is out in the wild. Many algorithmic bias mitigation strategies focus on risk management, but this doesn\u2019t change the fact that a lot of decision making \u2013 either human or algorithmic decision making \u2013 is made when the outcomes are unpredictable. Part of a successful algorithmic bias mitigation strategy means being aware of uncertainty and becoming comfortable in managing potentially uncomfortable situations.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">What types of uncertainty are important to algorithmic bias mitigation?<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li class=\"\"><strong>Data quality:<\/strong> Issues with data quality can often be unclear unless the team has collected the data themselves. Issues surrounding data quality can become particularly problematic when using or combining with third party datasets, and these issues may not always be obvious until much later in the project.<\/li>\n\n\n\n<li class=\"\"><strong>Statistical uncertainty: <\/strong>While models are able to make predictions, there is always a level of uncertainty in these which goes beyond errors and confident intervals. Additionally, there can be confusion and uncertainty between people working at the same organisation as to how to interpret statistical output.<\/li>\n\n\n\n<li class=\"\"><strong>Organisational uncertainty: <\/strong>&nbsp;There can be a lot of uncertainty on a project due to people leaving, project\u2019s changing hands, mismatched team co-ordination, and other organisational challenges. Sometimes people who work on a project can have very conflicting ideas about parts of the project at hand (Bates et al., 2024, Beresford, 2024).<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Worksheets<\/h3>\n\n\n\n<div data-wp-interactive=\"core\/file\" class=\"wp-block-file\"><object data-wp-bind--hidden=\"!state.hasPdfPreview\" hidden class=\"wp-block-file__embed\" data=\"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/wp-content\/uploads\/sites\/3\/2025\/09\/Handling-uncertainity-.pdf\" type=\"application\/pdf\" style=\"width:100%;height:600px\" aria-label=\"Embed of Handling uncertainity.\"><\/object><a id=\"wp-block-file--media-4370e3fb-7f57-4baa-a830-c4730bd83661\" href=\"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/wp-content\/uploads\/sites\/3\/2025\/09\/Handling-uncertainity-.pdf\">Handling uncertainity<\/a><a href=\"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/wp-content\/uploads\/sites\/3\/2025\/09\/Handling-uncertainity-.pdf\" class=\"wp-block-file__button wp-element-button\" download aria-describedby=\"wp-block-file--media-4370e3fb-7f57-4baa-a830-c4730bd83661\">Download<\/a><\/div>\n\n\n\n<h3 class=\"wp-block-heading\">Further Resources<\/h3>\n\n\n\n<p class=\"\">Bates, J., Kennedy, H., Medina Perea, I., Oman, S., &amp; Pinney, L. (2024). Socially meaningful transparency in data-based systems: Reflections and proposals from practice. <em>Journal of Documentation, 80<\/em>(1), 54-72. https:\/\/doi.org\/10.1108\/JD-01-2023-0006<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Implementing algorithmic systems involves a lot of uncertainty, be it because of the inherent uncertainty in the results of the systems themselves, due to organisational uncertainty regarding the history and [&hellip;]<\/p>\n","protected":false},"author":7,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"nf_dc_page":"","footnotes":""},"class_list":["post-34","page","type-page","status-publish","hentry"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Dealing with uncertainty - AlgoBias ToolKit<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/dealing-with-uncertainty\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Dealing with uncertainty - AlgoBias ToolKit\" \/>\n<meta property=\"og:description\" content=\"Implementing algorithmic systems involves a lot of uncertainty, be it because of the inherent uncertainty in the results of the systems themselves, due to organisational uncertainty regarding the history and [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/dealing-with-uncertainty\/\" \/>\n<meta property=\"og:site_name\" content=\"AlgoBias ToolKit\" \/>\n<meta property=\"article:modified_time\" content=\"2025-10-09T11:05:08+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/lifeofdata.org\\\/site\\\/algobias-toolkit\\\/dealing-with-uncertainty\\\/\",\"url\":\"https:\\\/\\\/lifeofdata.org\\\/site\\\/algobias-toolkit\\\/dealing-with-uncertainty\\\/\",\"name\":\"Dealing with uncertainty - AlgoBias ToolKit\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/lifeofdata.org\\\/site\\\/algobias-toolkit\\\/#website\"},\"datePublished\":\"2024-10-22T12:15:32+00:00\",\"dateModified\":\"2025-10-09T11:05:08+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/lifeofdata.org\\\/site\\\/algobias-toolkit\\\/dealing-with-uncertainty\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/lifeofdata.org\\\/site\\\/algobias-toolkit\\\/dealing-with-uncertainty\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/lifeofdata.org\\\/site\\\/algobias-toolkit\\\/dealing-with-uncertainty\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/lifeofdata.org\\\/site\\\/algobias-toolkit\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Dealing with uncertainty\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/lifeofdata.org\\\/site\\\/algobias-toolkit\\\/#website\",\"url\":\"https:\\\/\\\/lifeofdata.org\\\/site\\\/algobias-toolkit\\\/\",\"name\":\"AlgoBias ToolKit\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/lifeofdata.org\\\/site\\\/algobias-toolkit\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Dealing with uncertainty - AlgoBias ToolKit","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/dealing-with-uncertainty\/","og_locale":"en_GB","og_type":"article","og_title":"Dealing with uncertainty - AlgoBias ToolKit","og_description":"Implementing algorithmic systems involves a lot of uncertainty, be it because of the inherent uncertainty in the results of the systems themselves, due to organisational uncertainty regarding the history and [&hellip;]","og_url":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/dealing-with-uncertainty\/","og_site_name":"AlgoBias ToolKit","article_modified_time":"2025-10-09T11:05:08+00:00","twitter_card":"summary_large_image","twitter_misc":{"Estimated reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/dealing-with-uncertainty\/","url":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/dealing-with-uncertainty\/","name":"Dealing with uncertainty - AlgoBias ToolKit","isPartOf":{"@id":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/#website"},"datePublished":"2024-10-22T12:15:32+00:00","dateModified":"2025-10-09T11:05:08+00:00","breadcrumb":{"@id":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/dealing-with-uncertainty\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/lifeofdata.org\/site\/algobias-toolkit\/dealing-with-uncertainty\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/dealing-with-uncertainty\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/"},{"@type":"ListItem","position":2,"name":"Dealing with uncertainty"}]},{"@type":"WebSite","@id":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/#website","url":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/","name":"AlgoBias ToolKit","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"}]}},"_links":{"self":[{"href":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/wp-json\/wp\/v2\/pages\/34","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/wp-json\/wp\/v2\/comments?post=34"}],"version-history":[{"count":3,"href":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/wp-json\/wp\/v2\/pages\/34\/revisions"}],"predecessor-version":[{"id":101,"href":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/wp-json\/wp\/v2\/pages\/34\/revisions\/101"}],"wp:attachment":[{"href":"https:\/\/lifeofdata.org\/site\/algobias-toolkit\/wp-json\/wp\/v2\/media?parent=34"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}