“Not that you lied to me but that I no longer believe you has shaken me.” —Friedrich Nietzsche, Beyond Good and Evil

Imagine you’re a litigation partner at a law firm. You have a brand-new associate who seems to surpass all expectations: works 24 hours a day, seven days a week, 365 days a year; reads and absorbs millions of pages of material in a fraction of a second.

What’s the catch? The associate is subject to random hallucinations and occasionally making things up out of whole cloth that are extremely convincing—but totally false. In short, that’s AI at work for you—at least, as it currently exists. More specifically, generative pre-trained transformers, or GPT as you’ve probably heard it referred to.

Yet, the legal technology-market messaging is very different. Amazing. Groundbreaking. Game-changing. Revolutionary. While some healthy skepticism has begun to creep into the larger cultural milieu surrounding the AI revolution, when it comes to marketing the newest generation of artificial intelligence tools rapidly making their way into lawyers’ toolboxes, hyperbole fails—putting it mildly. If you listen to even a fraction of the unabashed market razzmatazz surrounding new legal AI tools, it’s the greatest boon to the legal profession since the copy machine.

But is it that straightforward? Are glory and prosperity just a few well-placed keystrokes away? Have we carefully considered the risks with prudence and deliberation, doing our due diligence on every possible pitfall? Let’s just say the jury is still out on that.

Putting aside all the nifty demos and incessant cheerleading, if this technology is going to have the impact on the legal industry predicted for it, there is one issue that needs to be understood and addressed: Can generative AI handle the truth? As the AI technology becomes more pervasive, answering that question is something that more than just a few good lawyers should be taking a hard look at.

As much as the hyperventilating hype purveyors may want to avoid or gloss over the subject, there’s no algorithm for determining whether something is true or false, accurate, misleading, or completely made-up. In fact, highly convincing, completely made-up statements are regular occurrences. Indeed, a whole industry has sprung up attempting to vet GPT generated content for veracity.

Yet, figuring out what the facts are—i.e., seeking the truth—is fundamental to our legal system. We refer to juries (and judges in bench trials) as triers or finders of fact. Along with applying the law to the facts, determining what really happened (i.e., the truth, again) is the raison d’etre of the legal process.

Regardless of your position on where AI currently falls on its evolutionary spectrum, there are some irrefutable truths to keep in mind as you are confronted with the marketing machine trying to sell you on the AI utopia just around the corner . . . if you will just part with a subscription fee:

  1. The underlying technology is not new. The technology collectively referred to as GPT has been around for a long time. Machine learning and neural networks since the 1950s, generative AI since the 1960s, natural language processing since the 1970s, and deep learning since the 1980s. Advances in computing power and the vast amount of content available on the entire internet (garbage in, anyone?) have enabled what is being portrayed as a revolution in computer thinking.
  2. GPT chooses a word to follow the previous one based on probabilities. It puts together sentences based on analyzing vast amounts of text (which have been converted into numbers) and then calculates the probability that a given word will follow another one (with a random element built in to avoid complete replication). It has been described as autocomplete on steroids. That’s a pretty good analogy.
  3. GPT doesn’t think, comprehend, understand, reason, or have any judgment whatsoever. It views your questions and its answers as numerical patterns devoid of meaning or context. Neither truth, falsity, reliability, or accuracy enter into it. To sum it up, you might say, it’s not intelligent.

When I asked ChatGPT whether it understands the truth, I got the following response:

I don’t possess personal beliefs or consciousness to understand truth or falsity in the way humans do. My responses are based on patterns in the data I’ve been trained on, but I don’t have the capacity to discern truth or falsity in a subjective or philosophical sense.

At a time in which the truth and the facts are increasingly viewed by some as rare commodities, our legal system needs to maintain trust and faith in its integrity. It is imperative therefore that lawyers using this new generation of AI tools exercise the highest level of care and diligence in their application and work hard to understand the technology’s strengths as well as its limitations.

In the end, GPT is just a tool—nothing more, nothing less. It can be used well or badly. There are some potentially very helpful uses of this technology, but there still are some important issues to be worked out. The probability that it’s going to replace human lawyers any time soon is about the same as the odds that your smartphone and your garage-door opener are going to conspire to steal your self-driving electric car.


15 thoughts on “Artificial stupidity: Can GPT handle the truth?”
  1. Купить двери на заказ в Москве
    Изготовление дверей на заказ по индивидуальным размерам
    Советы по выбору дверей на заказ
    Материалы и цвета дверей на заказ
    Услуги по доставке и установке дверей на заказ
    Бюджетные варианты дверей на заказ
    Ламинированные двери на заказ: преимущества и недостатки
    Металлические двери на заказ: надежность и безопасность
    Двери на заказ у мастеров-ремесленников
    Двери на заказ [url=http://www.mebel-finest.ru/]http://www.mebel-finest.ru/[/url].

  2. Посетите нашу страницу [url=https://psychotestinsights.blogspot.com/2023/12/blog-post.html]https://psychotestinsights.blogspot.com/2023/12/blog-post.html[/url], чтобы познакомиться с миром психологических тестов и их значением в нашей повседневной жизни. В мире современности, где стресс и быстрый темп жизни становятся нормой, понимание себя через психологические тесты может быть чрезвычайно познавательным, но и важным.

    Наш блог предоставляет уникальный взгляд на множество психологические тесты, их историю и применяемость в различных сферах. Мы разбираем, как итоги этих тестов могут посодействовать вам в развитии личности, профессиональной деятельности и улучшении межличностных отношений. Каждый тест – это способ узнать себя лучше и своих неосознанных возможностей.

    В нашем блоге вы https://psychotestinsights.blogspot.com/2023/12/blog-post.html можете обнаружить советы о том, как правильно интерпретировать результаты тестов и как применять их для повышения жизненного комфорта.

  3. На нашем сайте [url=https://citaty12345.blogspot.com/]https://citaty12345.blogspot.com/[/url] вы откроете для себя мотивирующую коллекцию цитат, которые способны оказать глубокое влияние на вашу мышление. Цитаты от исторических личностей собраны здесь, чтобы принести вам свежие взгляды для саморазвития.

    Наш блог создан не только для исследователей мудрости, но и для всех, кто стремится обрести мудрость и вдохновение в словах. Здесь вы найдете цитаты на самые разные темы: от успеха и саморазвития до вдохновляющих идей. Каждая цитата – это глубокое послание, которое имеет силу повлиять на ваш жизненный путь.

    Мы внимательно подбираем цитаты, чтобы они были значимыми. Наши материалы позволяют вам погрузиться в мир глубоких мыслей, предлагая новые горизонты мышления. Мы убеждены, что умело выбранные слова являются источником новых идей.

    Подписывайтесь нашего блога https://citaty12345.blogspot.com/ и обнаруживайте для себя новые цитаты ежедневно. Независимо от того, ищете ли вы мотивацию или просто хотите насладиться красотой слов, наш блог предложит вам точно то, что вам требуется. Позвольте этим цитатам войти в вашего ежедневного вдохновения.

  4. На нашем сайте [url=https://citaty12345.blogspot.com/]https://citaty12345.blogspot.com/[/url] вы сможете обнаружить познавательную коллекцию цитат, которые способны оказать глубокое влияние на вашу мышление. Цитаты от исторических личностей собраны здесь, чтобы принести вам новые идеи для саморазвития.

    Наш блог предназначен не только для любителей литературы и философии, но и для всех, кто ищет новые идеи в словах. Здесь вы найдете цитаты на всевозможные темы: от жизненной мудрости до личностного роста. Каждая цитата – это краткое послание, которое может изменить ваш мировоззрение.

    Мы тщательно отбираем цитаты, чтобы они были значимыми. Наши посты позволяют вам окунуться в мир мудрости, расширяя новые возможности. Мы убеждены, что тщательно отобранные слова служат источником мотивации.

    Присоединяйтесь нашего блога https://citaty12345.blogspot.com/ и обнаруживайте для себя новые цитаты регулярно. Независимо от того, стремитесь ли вы утешение или просто хотите насладиться красотой слов, наш блог представит вам именно то, что вам необходимо. Позвольте этим цитатам стать частью вашего постоянного вдохновения.

  5. Hey just wanted to give you a brief heads up and let you know a few of the images aren’t loading properly. I’m not sure why but I think its a linking issue. I’ve tried it in two different internet browsers and both show the same results.

  6. It is the best time to make some plans for the future and it’s time to be happy. I have learn this post and if I may just I wish to recommend you some interesting issues or advice. Perhaps you can write subsequent articles relating to this article. I wish to learn more things approximately it!

  7. Hello! I know this is kinda off topic but I’d figured I’d ask. Would you be interested in exchanging links or maybe guest authoring a blog article or vice-versa? My blog goes over a lot of the same subjects as yours and I believe we could greatly benefit from each other. If you might be interested feel free to send me an e-mail. I look forward to hearing from you! Excellent blog by the way!

  8. Thanks for another magnificent post. The place else may anyone get that kind of information in such an ideal approach of writing? I’ve a presentation next week, and I’m at the search for such info.

  9. What is Renew? Renew is a dietary supplement designed to support blood flow while also aiming to boost testosterone levels and provide an explosive energy drive

  10. Attractive section of content. I just stumbled upon your weblog and in accession capital to assert that I acquire in fact enjoyed account your blog posts. Any way I’ll be subscribing to your feeds and even I achievement you access consistently quickly.

  11. Thanks for ones marvelous posting! I certainly enjoyed reading it, you will be a great author.I will ensure that I bookmark your blog and will come back someday. I want to encourage you to continue your great writing, have a nice weekend!

Leave a Reply

Your email address will not be published. Required fields are marked *