Responsible AI tool selection for researchers

Following recent advances in Generative Artifical Intelligence (Gen AI) researchers are increasingly exploring how Artifical Intelligence (AI) tools might be leveraged within the research cycle. The University provides approved access to the Enterprise version of Microsoft Co-Pilot which you can access via your University account. Ensure the green shield labelled ‘Enterprise data protection applies to this chat’ is showing so that you know you are safely using the Enterprise version. This version keeps your information safe and does not expose you to having to agree to legally problematic terms and conditions.

In addition, there are a plethora of AI tools available to support specific tasks that a researcher might encounter. Many of these are available on a free, freemium, or subscription basis and may contain problematic terms and conditions that a researcher needs to consider before the tool can be used. To help researchers navigate this landscape responsibly, Libraries and Learning Resources have developed two sources of support – an Evaluative Framework for AI tools outlining the questions a researcher should consider before using an AI tool (see below), and licencing review guidance to assist with reviewing terms and conditions once a tool has been identified.

The Evaluative Framework for AI tools

The Evaluative Framework for AI tools has been developed to help you make informed decisions when selecting a new AI tool to use. It provides you with a series of questions to ask yourself, ranging from the relevance of using an AI Tool for the task at hand to whether the use of a tool is compliant with stakeholder policies relevant to you as a researcher. It is also available as a one-page Word document (DOCX - 25 KB).

Relevance of tool

  • How does this tool compare to alternatives?
  • Is it the best tool for your purpose?
  • How does it impact on skill acquisition?

Prompting and input rights

  • Tip: use the TAP and TASTE methods for effective prompting.
  • Are your prompts or inputs added to the service?
  • Do you provide the vendor with rights to your inputs?
  • Do you need to be the rights owner of any inputs?
  • Do you have ethical approval to input your research data?

Outputs

  • How useful is the output?
  • Are the outputs accurate?
  • Are there any limits on what you can do with outputs?

Policy compliance and ethics

  • Does use of the tool comply with funder policies?
  • Does use of the tool comply with publisher policies?
  • Does it comply with institutional policies?
  • Does use of the tool raise any ethical concerns?
  • Is my choice of tool the most environmentally sustainable option?

Corpus

  • Is the underlying data suitable for your needs?
  • Is it transparent what the model has been trained on?
  • What bias may be in the corpus?
  • Are the date periods for the corpus suitable for your needs?

Costs

  • How much does the tool cost?
  • Do you have institutional access?
  • What would you do if high charges started to be charged for a free product?

Terms, conditions and data security

Do the terms and conditions raise any issues regarding:

  • Intellectual Property rights of inputs/outputs?
  • Accessibility standards not being met?
  • Are you indemnifying the supplier?
  • UK Data protection laws not being met?

Next Steps

Go to our AI Tools Licensing Review Guidance for more information on how to review terms and conditions of AI tools that you have identified and would now like to register for or purchase.

Further information

Sign up for the Introduction to AI Tools for Researchers session from the Research Skills Team for a detailed introduction to the Evaluative Framework for AI Tools and how it can be used in the context the current AI Tools landscape.

The UK Research Integrity Office (UKRIO) have recently launched new guidance on Embracing AI with integrity: a practical guide for researchers. Further information specific to University of Birmingham can be found in the Student and PGR guidance for using GenAI tools ethically for work and in the general University guidance for using AI in teaching and assessment.

Colleges staff intranet

Professional Services staff intranet