Can ChatGPT AI Tool Pass the Bar Exam?
OpenAI’s latest chatbot, ChatGPT-4, has passed the Uniform Bar Examination with a top 10th percentile score, raising excitement and concerns within the legal field.
Developed by OpenAI, co-founded by Elon Musk and Sam Altman, ChatGPT-4 uses deep learning techniques to generate human-like responses.
Its latest version has advancements in creativity, visual input and longer context, allowing it to respond to images.
However, despite its exam success, it does not possess the ability to practice law effectively.
It can, however, offer AI-powered legal research, document drafting and contract analysis tools, proving to be a valuable asset for lawyers.
It won’t replace lawyers due to copyright issues, ethical concerns and the lack of understanding nuanced cases.
Despite potential risks, the automation of routine tasks can revolutionize the legal profession.
What is the Bar Exam?
The bar exam is a crucial requirement for law practitioners in the U.S., differing per state.
It is administered by agencies of individual states and territories and the exam typically lasts two days and includes multiple-choice questions, essay questions and “performance tests”.
The National Conference of Bar Examiners (NCBE) creates several component tests used by most jurisdictions, barring Louisiana and Puerto Rico which follow different civil law systems.
A degree from a law school or an apprenticeship is typically required before taking the bar exam.
Post-graduation, law school graduates usually undergo “bar review” prior to sitting for the exam.
Renowned for its difficulty, the bar exam’s pass rates can sometimes dip as low as 30%.
The exam format includes multiple choice and essay questions and is split across several lengthy sessions.
Did ChatGPT pass the bar exam?
Research by professors from Illinois Tech and Michigan State College of Law shows that OpenAI’s GPT-3.5 could achieve passing rates in two categories of the multistate bar exam (MBE), demonstrating a “general understanding of the legal domain”.
Meanwhile, law professors from the University of Minnesota tested GPT-3.5 against four different course assessments in their law degree program.
The model managed to produce average scores, receiving a grade of C+ but still passed.
These findings suggest that if ChatGPT were a student, it might be capable of earning a law degree.
The research reveals promising prospects for the application of AI in the field of law, even though it is not meant to replace human legal professionals.
Did GPT 4 pass the bar exam?
OpenAI’s advanced AI model, GPT-4, achieved remarkable success in law examinations, scoring in the 88th percentile for the Law School Admission Test (LSAT) and the top 90th percentile for the Bar exam.
These results represent significant progress from the previous model, GPT-3, which scored within the bottom 10% of test-takers.
GPT-4 not only passed the multiple-choice part of the Bar exam, but also exceeded both prior LLM’s scores and the average score of real-life Bar exam takers in both written portions.
The recent passing mark on the Bar exam showcases OpenAI’s language models’ capacity for exam success, surprising many with its ability to effectively handle complex, domain-specific tasks.
I hope you found this article informative.
Also read other articles on ChatGPT in this website.
See also:
