How Smart Is ChatGPT?
BY TYLER DURDEN - SATURDAY, APR 29, 2023 - 12:20 AM
ChatGPT, a language model developed by OpenAI, has become incredibly popular over the past year due to its ability to generate human-like responses in a wide range of circumstances.
This version, ChatGPT-3.4 do not have up-to-date info after 2021.
In fact, ChatGPT has become so competent, that students are now using it to help them with their homework. This has prompted several U.S. school districts to block devices from accessing the model while on their networks.
So, how smart is ChatGPT?
In a technical report released on March 27, 2023, OpenAI provided a comprehensive brief on its most recent model, known as GPT-4. Included in this report were a set of exam results, which Visual Capitalist Marcus Lu and Rosey Eason visualized in the graphic above.
GPT-4 vs. GPT-3.5
To benchmark the capabilities of ChatGPT, OpenAI simulated test runs of various professional and academic exams. This includes SATs, the bar examination, and various advanced placement (AP) finals.
Performance was measured in percentiles, which were based on the most recently available score distributions for test takers of each exam type.
Percentile scoring is a way of ranking oneâs performance relative to the performance of others. For instance, if you placed in the 60th percentile on a test, this means that you scored higher than 60% of test-takers.
The following table lists the results that we visualized in the graphic.
The scores reported above are for GPT-4 with visual inputs enabled. Please see OpenAIâs technical report for more comprehensive results.
As we can see, GPT-4 (released in March 2023) is much more capable than GPT-3.5 (released in March 2022) in the majority of these exams. It was, however, unable to improve in AP English and in competitive programming.
Regarding AP English (and other exams where written responses were required), ChatGPTâs submissions were graded by â1-2 qualified third-party contractors with relevant work experience grading those essaysâ. While ChatGPT is certainly capable of producing adequate essays, it may have struggled to comprehend the examâs prompts.
For competitive programming, GPT attempted 10 Codeforces contests 100 times each. Codeforces hosts competitive programming contests where participants must solve complex problems. GPT-4âs average Codeforces rating is 392 (below the 5th percentile), while its highest on a single contest was around 1,300. Referencing the Codeforces rating page, the top-scoring user is Jiangly from China with a rating of 3,841.
Whatâs Changed With GPT-4?
Here are some areas where GPT-4 has improved the user experience over GPT-3.5.
Internet Access and Plugins
A limiting factor with GPT-3.5 was that it didnât have access to the internet and was only trained on data up to June 2021.
With GPT-4, users will have access to various plugins that empower ChatGPT to access the internet, provide more up-to-date responses, and complete a wider range of tasks. This includes third-party plugins from services such as Expedia which will enable ChatGPT to book an entire vacation for you.
Visual Inputs
While GPT-3.5 could only accept text inputs, GPT-4 -4 has the ability to also analyze images. Users will be able to ask ChatGPT to describe a photo, analyze a chart, or even explain a meme.
Greater Context Length
Lastly, GPT-4 is able to handle much larger amounts of text and keep conversations going for longer. For reference, GPT-3.5 had a max request value of 4,096 tokens, which is equivalent to roughly 3,000 words. GPT-4 has two variants, one with 8,192 tokens (6,000 words) and another with 32,768 tokens (24,000 words).
âQUITE IMPRESSED WITH THE INITIAL TEST OF GPT-4
"As an AI language model, I have knowledge about various conspiracy theories that have emerged over the years. Conspiracy theories are narratives or explanations that propose secretive or hidden actions by powerful entities or groups to manipulate events, control society, or suppress information. These theories often involve complex and far-reaching plots, involving governments, organizations, or individuals.
It's important to note that conspiracy theories are not based on verified evidence or widely accepted by experts in the relevant fields. They often rely on speculation, anecdotal evidence, misinterpretation of facts, or a lack of understanding of complex events. Conspiracy theories can vary widely, covering topics such as government cover-ups, secret societies, false flag operations, or the existence of hidden technologies or beings.
While some conspiracy theories have been proven to be hoaxes or debunked through rigorous investigation and evidence, others persist despite a lack of substantial evidence. It's crucial to approach conspiracy theories with critical thinking and skepticism, relying on credible sources, expert opinions, and verifiable evidence.
It's also worth noting that the proliferation of misinformation and the spread of conspiracy theories have been facilitated by the rapid dissemination of information on the internet and social media platforms. It's essential to be discerning consumers of information, fact-check claims, and consult reputable sources to avoid falling into the trap of false or misleading narratives."
Tell me about the grain production in Ukraine
ChatGPT
"Ukraine is known as the "breadbasket of Europe" due to its significant agricultural sector, including grain production. The country has favorable natural conditions, such as fertile soil and a temperate climate, which make it well-suited for agricultural activities.
Grain production plays a vital role in Ukraine's agricultural economy. The country is one of the world's leading producers and exporters of several major grains, including wheat, corn (maize), and barley. Other grains produced in Ukraine include oats, rye, and millet.
Wheat is one of the primary grains grown in Ukraine. The country produces both winter and spring wheat varieties. Ukrainian wheat is known for its quality and is exported to various countries around the world.
Corn is another important grain crop in Ukraine. The country has favorable conditions for corn cultivation, and it is one of the top global producers of corn. Ukrainian corn is used for various purposes, including animal feed and the production of ethanol.
Barley is also a significant grain crop in Ukraine, with both winter and spring varieties being cultivated. It is used for various purposes, including malting for beer production and animal feed.
The Ukrainian government has implemented policies to support and develop the agricultural sector, including grain production. These policies aim to increase yields, improve infrastructure, and stimulate export opportunities.
It's worth noting that specific information on grain production in Ukraine, such as crop yields, export volumes, or market dynamics, can vary from year to year due to factors such as weather conditions, global market trends, and agricultural practices. For the most up-to-date and detailed information, it is advisable to consult reports and statistics from agricultural authorities, trade organizations, or international agricultural institutions."
Tell me about Norwegian investments in Brazil
ChatGPT
"Norwegian investments in Brazil have been significant across various sectors, including energy, oil and gas, renewable energy, telecommunications, shipping, and fisheries. Norway is known for its strong presence in the Brazilian market and has made substantial investments over the years.
One notable area of Norwegian investment in Brazil is the energy sector. Norway's state-owned oil company, Equinor (formerly Statoil), has been actively involved in offshore oil and gas exploration and production in Brazil. Equinor has made significant investments in Brazil's pre-salt oil fields, including projects such as Peregrino, Roncador, and CarcarĂĄ.
In addition to oil and gas, Norway has also shown interest in Brazil's renewable energy sector. Norwegian companies have invested in wind power projects, particularly in the northeastern region of Brazil, which has favorable wind conditions. For example, Statkraft, a Norwegian state-owned renewable energy company, has developed several wind farms in Brazil.
Norwegian companies have also made investments in other sectors. In telecommunications, Telenor, a Norwegian telecommunications company, has a presence in the Brazilian market through its subsidiary, Telenor Brasil. The company offers mobile services and has invested in expanding its network coverage.
Furthermore, Norwegian shipping companies have long-standing operations in Brazil, capitalizing on the country's significant maritime trade. Norwegian fisheries and seafood companies have also established a presence in Brazil, importing and distributing seafood products.
It's important to note that specific investment figures and projects can vary over time, and it's recommended to consult updated sources and reports for the most accurate and recent information on Norwegian investments in Brazil."
Do you know the history of the Algonquin Hotel in NYC?
ChatGPT
Yes, I can provide you with a brief overview of the history of the Algonquin Hotel in New York City.
The Algonquin Hotel is a historic hotel located in Midtown Manhattan, New York City. It opened its doors in 1902 and quickly became a cultural landmark, known for its association with the literary and theatrical circles of the early 20th century.
One of the notable aspects of the Algonquin Hotel's history is its association with the literary group known as the "Algonquin Round Table." In the 1920s, a group of writers, critics, and actors, including Dorothy Parker, Robert Benchley, and Alexander Woollcott, among others, began meeting regularly for lunch and engaging in witty and intellectual discussions at the Algonquin's Rose Room. These gatherings, marked by sharp humor and lively banter, became renowned and played a significant role in shaping American literary and cultural discourse.
During its early years, the Algonquin Hotel was also known for its luxurious accommodations and amenities. It featured stylish guest rooms, a rooftop garden, a bar, and a restaurant, all catering to an upscale clientele.
Over the years, the Algonquin has gone through various renovations and changes in ownership. In the 1980s, the hotel underwent a major restoration to preserve its historic character and charm. Today, it continues to operate as a boutique hotel, blending modern comforts with its rich literary and artistic heritage.
The Algonquin Hotel's legacy as a gathering place for creative minds and its association with the Algonquin Round Table has made it an iconic landmark in New York City's cultural history.
Do you know of the famous little bar they had?
ChatGPT
Yes, the Algonquin Hotel is known for its famous bar, called the "Blue Bar." The Blue Bar has been a cherished institution within the hotel since its early years and remains a popular spot for both hotel guests and visitors.
The Blue Bar has a rich history and is often associated with the literary and artistic circles that frequented the Algonquin Hotel. It served as a gathering place for the members of the Algonquin Round Table and other notable personalities of the time.
The bar's name, the "Blue Bar," is derived from its distinctive blue decor and ambiance. It has a cozy and intimate atmosphere, with dark wood paneling, low lighting, and comfortable seating. The walls are adorned with photographs and artwork that pay tribute to the hotel's illustrious history.
The Blue Bar continues to be a popular destination for patrons seeking a classic New York City bar experience. It offers a selection of cocktails, wines, and spirits, and maintains the tradition of providing a sophisticated yet relaxed setting for conversation and socializing.
The combination of its historical significance, elegant atmosphere, and association with the Algonquin Round Table has made the Blue Bar a notable destination within the Algonquin Hotel, attracting visitors from around the world.
Private info. Â In the 60/the 70s, while working in the London travel industry, we had a fixed reservation in a luxurious top-floor suite reached by the old-style open mesh elevator. I often frequented the little bar on the right, just inside the main door.
