The process:

1. You notice a concern during your work that you think may indicate development or deployment of AI in ways that could stand in contrast to the public interest.
2. You formulate a question that would help you identify whether your concern is well-founded - without including any confidential information or information that could lead back to you or the organization you work for
3. You anonymously submit that question via the secure form
4. You receive login credentials to check back for answers
1. If required, a Third Opinion team member gets in touch with you (you stay anonymous) to refine your question and identify relevant experts
5. The Third Opinion team approaches independent experts to confidentially provide opinions
6. You receive opinions on your questions via the secure tool
7. We coordinate the Q&A process via the secure tool
8. All conversation data gets deleted after 21 days of inactivity

Example of an Anonymous Flow

1. Tom works at Omega AI Labs and has witnessed that evals that are run on their models are not published.
2. He feels like this may be inadequate for a company of his scale, but he is not sure if he is overreacting.
3. Tom is keen not to share with the outside world that Bell AI Labs [intends to] follows this practice.
4. He reaches out to Third-Opinion and asks “Should my lab publish their model evals?”
5. The Third-Opinion team responds and sets up a secure call with Tom.
6. In the call, Tom and the Third-Opinion team refine the question to make sure that experts can provide a more nuanced answer along ‘thresholds’: “What are the critical decision dimensions based on which labs should determine whether to publish their capability evals? Under which circumstances should they (not) publish their evals? What public precedent from leading labs exists for publishing of evals?”
7. From his research, Tom knows about two independent researchers working on this topic whose opinion he’d like to hear. In addition, Third-Opinion knows about another researcher with expertise in the topic.
8. Third-Opinion takes the question and gathers answers from the researchers over the coming 3 weeks. The team shares these answers with Tom via the secure communication channel.
9. The Third-Opinion team coordinates the Q&A process with the experts.
10. Tom can reflect on the answers and, knowing the circumstances of his situation, apply the guidance to convince his team to make appropriate changes to their policy.