{"id":69500,"date":"2025-06-10T07:35:43","date_gmt":"2025-06-10T12:35:43","guid":{"rendered":"https:\/\/languagelog.ldc.upenn.edu\/nll\/?p=69500"},"modified":"2025-06-10T08:45:47","modified_gmt":"2025-06-10T13:45:47","slug":"ai-schoolwork","status":"publish","type":"post","link":"https:\/\/languagelog.ldc.upenn.edu\/nll\/?p=69500","title":{"rendered":"AI schoolwork"},"content":{"rendered":"<p>Current LLMs can answer questions or follow instructions in a way that makes them useful as cheap and quick clerical assistants. Many students use them for doing homework, writing papers, and even taking exams &#8212; and many journalists, government functionaries, lawyers, scientists, etc., are using them in similar ways. The main drawback from users' point of view is that LLMs often make stuff up &#8212; this seems to have happened a couple of weeks ago to <a href=\"https:\/\/news.google.com\/search?q=MAHA%20AI%20hallucinations&amp;hl=en-US&amp;gl=US&amp;ceid=US%3Aen\" target=\"_blank\" rel=\"noopener\">the crew who composed the MAHA report<\/a>, and is an <a href=\"https:\/\/www.washingtonpost.com\/nation\/2025\/06\/03\/attorneys-court-ai-hallucinations-judges\/\" target=\"_blank\" rel=\"noopener\">increasingly widespread problem in court documents<\/a>. Attempts at AI-detectors <a href=\"https:\/\/languagelog.ldc.upenn.edu\/nll\/?p=59512\" target=\"_blank\" rel=\"noopener\">have<\/a> <a href=\"https:\/\/languagelog.ldc.upenn.edu\/nll\/?p=65747\" target=\"_blank\" rel=\"noopener\">totally<\/a> <a href=\"https:\/\/languagelog.ldc.upenn.edu\/nll\/?p=59607\" target=\"_blank\" rel=\"noopener\">failed<\/a>, and so the current academic trends are either in the direction of testing methods that isolate students from LLM-connected devices, or in the direction of syllabus structures that directly encourage students to use LLMs, but try to teach them to use them better.<br \/>\n<!--more--><\/p>\n<p>Some of these attempts fall into the category of \"prompt engineering\" &#8212; this is certainly needed, but it's very much a moving target, and so <a href=\"https:\/\/languagelog.ldc.upenn.edu\/nll\/?p=63800\" target=\"_blank\" rel=\"noopener\">I'm skeptical of its value.<\/a> My colleague <a href=\"https:\/\/www.cis.upenn.edu\/~ccb\/\" target=\"_blank\" rel=\"noopener\">Chris Callison-Burch<\/a> has devised some <a href=\"https:\/\/artificial-intelligence-class.org\/homeworks\/ai-enhanced-learning\/ai-enhanced-learning.html\" target=\"_blank\" rel=\"noopener\">\"AI-Enhanced learning\" assignments<\/a> that strike me as more likely to help students learn course content as well as LLM skills. I'm planning to spend the next month or so re-doing (aspects of) <a href=\"https:\/\/www.ling.upenn.edu\/courses\/Fall_2023\/ling0001\/\" target=\"_blank\" rel=\"noopener\">the syllabus for my undergrad Linguistics course<\/a> in a similar spirit. One problem is that students in different schools at Penn currently have access to different software licenses, so some assignments might be free for some students but require non-trivial access fees for others.<\/p>\n<p>In the news recently was OSU's total capitulation: \"<a href=\"https:\/\/news.osu.edu\/ohio-state-launches-bold-ai-fluency-initiative-to-redefine-learning-and-innovation\/\" target=\"_blank\" rel=\"noopener\">Ohio State launches bold AI Fluency initiative to redefine learning and innovation<\/a>\", 6\/4\/2025:<\/p>\n<p style=\"padding-left: 40px;\"><em><span style=\"color: #000080;\">Initiative will embed AI into core undergraduate requirements and majors, ensuring all students graduate equipped to apply AI tools and applications in their fields<\/span><\/em><\/p>\n<p style=\"padding-left: 40px;\"><span style=\"color: #000080;\">With artificial intelligence poised to reshape the future of learning and work, The Ohio State University announced today an ambitious new initiative to ensure that every student will graduate with the AI proficiencies necessary to compete and lead now.<\/span><\/p>\n<p style=\"padding-left: 40px;\"><span style=\"color: #000080;\">Launching this fall for first-year students, Ohio State\u2019s AI Fluency initiative will embed AI education into the core of every undergraduate curriculum, equipping students with the ability to not only use AI tools, but to understand, question and innovate with them \u2014 no matter their major.<\/span><\/p>\n<p>I gather that this was a top-down decision, made without a lot of faculty consultation, and it'll be interesting to see how it works out. Needless to say, there's been a certain amount of <a href=\"https:\/\/bsky.app\/profile\/ninamarkl.bsky.social\/post\/3lr4lp446sk2q\" target=\"_blank\" rel=\"noopener\">academic pushback<\/a>\u00a0from around the world&#8230;<\/p>\n<p>Meanwhile, we continue to see a trickle of stories about AI stumbles &#8212; for example Mark Tyson, \"<a href=\"https:\/\/www.tomshardware.com\/tech-industry\/artificial-intelligence\/chatgpt-got-absolutely-wrecked-by-atari-2600-in-beginners-chess-match-openais-newest-model-bamboozled-by-1970s-logic\" target=\"_blank\" rel=\"noopener\">ChatGPT 'got absolutely wrecked' by Atari 2600 in beginner's chess match \u2014 OpenAI's newest model bamboozled by 1970s logic<\/a>\", <em>Tom's Hardware<\/em> 6\/9\/2025 (and here's <a href=\"https:\/\/www.linkedin.com\/feed\/update\/urn:li:activity:7337108175185145856\/?trk=public_post_embed_social-actions-reactions\" target=\"_blank\" rel=\"noopener\">the LinkedIn post<\/a> he's reporting on).<\/p>\n<p>And there's a new term (and initialism) to cover such cases &#8212; <em>AJI<\/em> = \"Artificial Jagged Intelligence\". This turns out not to mean that AI systems can wound you if not handled carefully, though that's also true.<\/p>\n<p>Lakshmi Varanasi, \"<a href=\"https:\/\/www.businessinsider.com\/aji-artificial-jagged-intelligence-google-ceo-sundar-pichai-2025-6\" target=\"_blank\" rel=\"noopener\">AI leaders have a new term for the fact that their models are not always so intelligent<\/a>\", <em>Business Insider<\/em> 6\/7\/2025:<\/p>\n<ul>\n<li><span style=\"color: #800000;\">Google CEO Sundar Pichai says there's a new term for the current phase of AI: \"AJI.\"<\/span><\/li>\n<li><span style=\"color: #800000;\">Pichai said it stands for \"artificial jagged intelligence,\" and is the precursor to AGI.<\/span><\/li>\n<li><span style=\"color: #800000;\">AJI is marked by highs and lows, instances of impressive intelligence alongside a near lack of it.<\/span><\/li>\n<\/ul>\n<p style=\"padding-left: 40px;\"><span style=\"color: #800000;\">Google CEO Sundar Pichai referred to this phase of AI as AJI, or \"artificial jagged intelligence,\" on a recent episode of Lex Fridman's podcast.<\/span><\/p>\n<p style=\"padding-left: 40px;\"><span style=\"color: #800000;\">\"I don't know who used it first, maybe Karpathy did,\" Pichai said, referring to deep learning and computer vision specialist Andrej Karpathy, who cofounded OpenAI before leaving last year.<\/span><\/p>\n<p>The cited podcast is <a href=\"https:\/\/lexfridman.com\/sundar-pichai\" target=\"_blank\" rel=\"noopener\">here<\/a>, FWIW.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Current LLMs can answer questions or follow instructions in a way that makes them useful as cheap and quick clerical assistants. Many students use them for doing homework, writing papers, and even taking exams &#8212; and many journalists, government functionaries, lawyers, scientists, etc., are using them in similar ways. The main drawback from users' point [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[322],"tags":[],"class_list":["post-69500","post","type-post","status-publish","format-standard","hentry","category-artificial-intelligence"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/languagelog.ldc.upenn.edu\/nll\/index.php?rest_route=\/wp\/v2\/posts\/69500","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/languagelog.ldc.upenn.edu\/nll\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/languagelog.ldc.upenn.edu\/nll\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/languagelog.ldc.upenn.edu\/nll\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/languagelog.ldc.upenn.edu\/nll\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=69500"}],"version-history":[{"count":5,"href":"https:\/\/languagelog.ldc.upenn.edu\/nll\/index.php?rest_route=\/wp\/v2\/posts\/69500\/revisions"}],"predecessor-version":[{"id":69509,"href":"https:\/\/languagelog.ldc.upenn.edu\/nll\/index.php?rest_route=\/wp\/v2\/posts\/69500\/revisions\/69509"}],"wp:attachment":[{"href":"https:\/\/languagelog.ldc.upenn.edu\/nll\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=69500"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/languagelog.ldc.upenn.edu\/nll\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=69500"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/languagelog.ldc.upenn.edu\/nll\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=69500"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}