www.cio.com
Open in
urlscan Pro
151.101.194.165
Public Scan
URL:
https://www.cio.com/article/647725/it-leaders-grapple-with-shadow-ai.html
Submission Tags: falconsandbox
Submission: On August 01 via api from US — Scanned from DE
Submission Tags: falconsandbox
Submission: On August 01 via api from US — Scanned from DE
Form analysis 1 forms found in the DOM
<form class="gsc-search-box gsc-search-box-tools" accept-charset="utf-8">
<table cellspacing="0" cellpadding="0" role="presentation" class="gsc-search-box">
<tbody>
<tr>
<td class="gsc-input">
<div class="gsc-input-box" id="gsc-iw-id1">
<table cellspacing="0" cellpadding="0" role="presentation" id="gs_id50" class="gstl_50 gsc-input" style="width: 100%; padding: 0px;">
<tbody>
<tr>
<td id="gs_tti50" class="gsib_a"><input autocomplete="off" type="text" size="10" class="gsc-input" name="search" title="search" aria-label="search" id="gsc-i-id1"
style="width: 100%; padding: 0px; border: none; margin: 0px; height: auto; background: url("https://www.google.com/cse/static/images/1x/en/branding.png") left center no-repeat rgb(255, 255, 255); outline: none;"
dir="ltr" spellcheck="false"></td>
<td class="gsib_b">
<div class="gsst_b" id="gs_st50" dir="ltr"><a class="gsst_a" href="javascript:void(0)" title="Clear search box" role="button" style="display: none;"><span class="gscb_a" id="gs_cb50" aria-hidden="true">×</span></a></div>
</td>
</tr>
</tbody>
</table>
</div>
</td>
<td class="gsc-search-button"><button class="gsc-search-button gsc-search-button-v2"><svg width="13" height="13" viewBox="0 0 13 13">
<title>search</title>
<path
d="m4.8495 7.8226c0.82666 0 1.5262-0.29146 2.0985-0.87438 0.57232-0.58292 0.86378-1.2877 0.87438-2.1144 0.010599-0.82666-0.28086-1.5262-0.87438-2.0985-0.59352-0.57232-1.293-0.86378-2.0985-0.87438-0.8055-0.010599-1.5103 0.28086-2.1144 0.87438-0.60414 0.59352-0.8956 1.293-0.87438 2.0985 0.021197 0.8055 0.31266 1.5103 0.87438 2.1144 0.56172 0.60414 1.2665 0.8956 2.1144 0.87438zm4.4695 0.2115 3.681 3.6819-1.259 1.284-3.6817-3.7 0.0019784-0.69479-0.090043-0.098846c-0.87973 0.76087-1.92 1.1413-3.1207 1.1413-1.3553 0-2.5025-0.46363-3.4417-1.3909s-1.4088-2.0686-1.4088-3.4239c0-1.3553 0.4696-2.4966 1.4088-3.4239 0.9392-0.92727 2.0864-1.3969 3.4417-1.4088 1.3553-0.011889 2.4906 0.45771 3.406 1.4088 0.9154 0.95107 1.379 2.0924 1.3909 3.4239 0 1.2126-0.38043 2.2588-1.1413 3.1385l0.098834 0.090049z">
</path>
</svg></button></td>
<td class="gsc-clear-button">
<div class="gsc-clear-button" title="clear results"> </div>
</td>
</tr>
</tbody>
</table>
</form>Text Content
* Topics * Events * Newsletters * Resources * Community ABOUT * About Us * Advertise * Contact Us * Foundry Careers * Reprints * Newsletters POLICIES * Privacy Policy * Cookie Policy * Member Preferences * About AdChoices * Your California Privacy Rights OUR NETWORK * Computerworld * CSO * InfoWorld * Network World MORE * Awards * Blogs * Brandposts * Events * Podcasts * Videos Close * Analytics * Artificial Intelligence * Generative AI * Business Operations * Careers * Cloud Computing * Data Center * Data Management * Emerging Technology * Enterprise Applications * Industry * IT Leadership * Digital Transformation * IT Strategy * IT Management * Innovation * Diversity and Inclusion * IT Operations * Project Management * Networking * Security * Software Development * Vendors and Providers Back Close AFRICA * Africa AMERICAS * Canada * United States ASIA * ASEAN * India * Middle East * 日本 (Japan) EUROPE * Ireland * Italia (Italy) * Netherlands * United Kingdom OCEANIA * Australia * New Zealand Back Close × search Popular Topics * IT Leadership * Digital Transformation * Innovation * Data Analytics & AI * Enterprise Applications * Diversity and Inclusion * Search * US-EN * Topics * Events * Newsletters * Resources * Community * About * Policies * Our Network * More Back TOPICS * IT Leadership * Digital Transformation * Innovation * Data Analytics & AI * Enterprise Applications * Diversity and Inclusion Back ABOUT * About Us * Advertise * Contact Us * Foundry Careers * Reprints * Newsletters Back POLICIES * Privacy Policy * Cookie Policy * Member Preferences * About AdChoices * Your California Privacy Rights Back OUR NETWORK * Computerworld * CSO * InfoWorld * Network World Back MORE * Awards * Blogs * Brandposts * Events * Podcasts * Videos HomeIT StrategyIT leaders grapple with shadow AI by Stan Gibson * * * * * * IT LEADERS GRAPPLE WITH SHADOW AI Feature Jul 27, 202310 mins Data and Information SecurityGenerative AIIT Governance * * * * * * * * * * * * Generative AI promises dramatic productivity gains, but rogue use must be curtailed until control is gained. Credit: Shutterstock / BalanceFormCreative Max Chan knew he had to do something. Soon after ChatGPT burst on the scene in November 2022, Chan realized generative AI would amount to far more than the just the latest technology flash-in-the-pan. With the ability to instantaneously ingest reams of data using large language models (LLMs), generative AI technologies such as OpenAI’s ChatGPT and Google’s Bard can produce reports, contracts, and application code far surpassing earlier technologies in speed, accuracy, and thoroughness. Result: dramatic productivity gains and potentially game-changing business advantage. “Employees are going to use this. If we don’t do anything about it, they will have no choice but to use it on their own,” says Chan, CIO of Avnet, a technology parts and services provider. Michele Goetz, vice president and principal analyst at Forrester Research, agrees. “There is a fear of missing out. Even if you say, ‘Don’t use it,’ your employees or customers are going to use it,” she says. “The Pandora’s box has been opened, so it’s best to partner with your employees so they don’t have to hide what they’re doing.” Despite its immense promise, generative AI can expose sensitive and proprietary information to public view. That could lead to compromised intellectual property and regulatory penalties. Moreover, generative AI results can sometimes be wildly erroneous, resulting in “confabulation,” or “hallucination.” And because the generative AI models pull from myriad sources, incorporating generative AI output in an organization’s corporate content could lead to copyright infringement. Some of those dangers were realized in April 2023 when Samsung employees inadvertently leaked sensitive internal data to ChatGPT, leading the company to temporarily ban employees’ usage of generative AI technology — an incident that put IT leaders on high alert about the impending rise in shadow AI that may soon take hold at their organizations if they don’t get in front of it. TWO-TRACK STRATEGY With those stakes in play, taking a hands-off approach was unthinkable for Chan. Instead, he’s implementing a dual-track strategy: to limit generative AI utilization through strict policies, while rapidly developing and piloting approved and safe applications. “If someone wants to try it, they have to submit a request and we have to review it, and we will work with them to build a minimum viable product,” he explains. The MVP could in turn evolve into a proof-of-concept (POC), and from there, usually with the help of a strategic partner, to a production implementation. Those early applications are now nearing fruition. “We will definitely be in production with a couple by the end of the year,” Chan says. Other CIOs have adopted similar strategies. “Our approach is one of cautious interest,” says Robert Pick, executive vice president and CIO for Tokio Marine North America, a multinational insurance provider with headquarters in Japan. While Pick is encouraging employees at the insurance company to experiment, he insists their activities be monitored. “In insurance, we live in data all the time — and in third-party data — that’s different from some industries. We have some comfort with the idea of our data going somewhere to be processed and then coming back. If we give professionals the right tools and guidance they will make the right decision,” says Pick. Despite the best efforts of Chan and Pick, Gartner foresees that unsanctioned usage will be impossible to prevent. The consultancy predicted in March 2023 that by 2026, 5% of employees will engage in unauthorized use of generative AI in their organizations. “If anything, 5% is conservative. I get calls every day from people wanting to know how to stop their employees from using ChatGPT,” says Avivah Litan, distinguished vice-president analyst at Gartner. CIOs realize that unless they quickly implement policies that allow and even encourage use of generative AI for some purposes, they will lose control over a transformative technology in their organizations. According to IDC, CIOs have gotten off the sidelines and are now getting out in front of the parade. In March 2023, 54% said they were not yet doing anything with regard to generative AI, but in June 2023, only 23% made that admission [see chart]. “In some cases, people are blocking; in other cases, they are adopting policies; and in still other cases they are conducting intentional pilots,” says Daniel Saroff, group vice president for consulting and research at IDC. IDC HACKATHON EXPOSES VULNERABILITIES At Parsons Corp., a global solutions provider in the national security and critical infrastructure markets, early instances of shadow AI spurred a conversation between Karen Wright, vice president of IT strategy, products, and commercialization, and her cybersecurity counterpart at Parsons. This followed a ChatGPT hackathon to identify security risks. “It was a really good approach to understanding the implications of the technology,” says Wright. The hackathon showed Wright and her fellow IT leaders at Parsons that ChatGPT was not qualitatively different from some web-based tools that employees were already using, such as Adobe Acrobat online services, in which data is sent outside an organization to be processed. Consequently, Parsons settled on the use of data-loss prevention (DLP) tools to prevent data exfiltration via generative AI. “Our focus is embracing and accelerating the use of smart artificial intelligence, while managing it with DLP tools to ensure security,” says Wright. Education also will play a critical role in taking control over generative AI at Parsons. “Our focus is educating employees on the best practices and tools to accomplish their goals while protecting the company,” Wright says. INSURERS UNDERSTAND RISK As a global insurer with a presence in many countries, TMG’s international units have been experimenting with generative AI. “We did see a tremendous amount of personal experimentation going on. But because we are risk-aware, there was not a rush to put everything on ChatGPT. The reaction was quick and clear: education and monitoring,” says Pick. TMG has set up working groups within its various companies to examine use cases such as drafting letters and marketing content to give humans a headstart on the process, according to Pick. Another prospective generative AI use case is for the various business units to draft reports on market conditions and performance. “Any company with many business units can benefit from generative AI’s ability to summarize information,” notes Pick. “To take an underwriting manual and summarize it in plain language could take seconds or minutes to get to a first draft, rather than days or weeks,” he says. “That will enable us to focus our people resources more efficiently in the future.” In addition to ingesting and generating written content, generative AI shows great potential in application development, according to Pick. The ability to translate in near real-time a stored procedure from one language into another with an accuracy rate of perhaps 60%, while including comments, will increase developer efficiency greatly, he asserts. “It could take weeks for a programmer to do the same thing. That will pay dividends for years,” Pick says. In addition, the use of private LLMs is immediately attractive for an insurance provider such as TMG. “There is the hope that it might find things humans would not notice. We’re also interested in ‘little LLMs,’ if we can get to that state, because you would not need a cloud data center. Instead, we would use sandboxes that are cordoned off so that we are stewarding the data,” says Pick. But even with private LLMs, regulation comes into play, says the CIO. “For a global company such as TMG to use a private LLM, the data would need to be loaded into a tenant system that is within the area governed by specific regulations, such as GDPR in Europe,” he explains. BUILDING ON POC Chan’s pursuit of both safety and opportunity shows promise in several POCs. “We are training Azure OpenAI with all the product information we have, so a business person can do a quick search to find a particular connector and can get back several examples, including which ones are in stock. It saves time because people no longer need to call the materials team,” Chan says. Azure OpenAI also generates custom contracts quickly. “By loading the last 10 years of contracts into the repository, we can say, ‘I need a contract for a particular project with such and such terms,’ and it comes up with a full contract within seconds,” says Chan. Sales executives can then review and tweak the contract before sending it to the customer. The quick turnaround is expected to result in quicker conversions of prospects to sales as well as happier customers. The process is similar with requests for proposals (RFPs), in which business analysts specify what they need and generative AI creates the RFP within seconds. “The business analyst just reviews and makes changes. This is a huge productivity gain,” says Chan. Engineers can also call upon generative AI to come up with possible solutions to customer demands, such as reducing the physical footprint of a circuit board by replacing certain components in the bill of materials, while shortening the go-to-market lead time. “It will return options. That is huge in terms of value,” Chan says. A CHALLENGE WORTH TAKING ON In general, CIOs are finding the upside of generative AI productivity justifies grappling with the challenges of controlling it. “We make sure the company data is safe, yet the AI is not lacking in capabilities for IT and business employees to innovate,” says Chan. According to Pick, generative AI will not make human workers obsolete, just more productive. “We don’t view it as a people replacement technology. It still needs a human caretaker,” he says. “But it can accelerate work, eliminate drudgery, and enable our employees to do things of a higher order, so we can focus people resources more acutely in the future.” Most important, Pick says, generative AI has much more potential than earlier much-hyped technologies. “This is not the next blockchain, but something that will really be valuable.” To extract that value, Goetz of Forrester says setting policies for generative AI is a matter of establishing clear dos and don’ts. She recommends, like Chan, following a two-track strategy in which approved generative AI applications and data sets are made available to employees, while AI applications and use cases that might put data in jeopardy are prohibited. Following the guidelines, according to Goetz, will make possible safe, self-service usage of generative AI in an organization. In the meantime, when developing or deploying gen AI capabilities, Saroff of IDC recommends assessing the controls that generative AI tools implement, as well as the unintended risks that might arise from the use of those AI tools. IDC RELATED CONTENT * * feature HOW GENERATIVE AI IMPACTS YOUR DIGITAL TRANSFORMATION PRIORITIES Heading into 2024, CIOs must reshape their digital agenda with the promise and perils of generative AI in mind. Here are five ways to address the disruptive potential of LLMs. By Isaac Sacolick Aug 01, 2023 8 mins Generative AI Generative AI Generative AI * feature HYPERSCALERS IN CROSSHAIRS FOR ANTI-COMPETITIVE PRICING AND LOCK-IN UK industry regulators see the market for public cloud infrastructure services as too concentrated, but AWS, Microsoft, and Google say it’s operating competitively. By Peter Sayer Aug 01, 2023 9 mins Regulation Microsoft Azure Google Cloud Functions * feature INVOKING IT TO HELP REVITALIZE INDIGENOUS LANGUAGES AT RISK OF EXTINCTION The Miami Tribe of Oklahoma and Miami University’s IT services partnered to develop a platform aimed at restoring the tribe’s dormant language. Now it is helping other tribal communities unearth their own ‘sleeping’ languages. By Sarah K. White Aug 01, 2023 10 mins CIO 100 Education Industry Diversity and Inclusion * news GENERATIVE AI USAGE GAINS TRACTION AMONG ENTERPRISES: MCKINSEY Although it is still early days for the technology, the McKinsey report showed its adoption is picking up across industry sectors. By Anirban Ghoshal Aug 01, 2023 2 mins Generative AI Artificial Intelligence Enterprise Applications * Podcasts * Videos * Resources * Events SUBSCRIBE TO OUR NEWSLETTER FROM OUR EDITORS STRAIGHT TO YOUR INBOX Get started by entering your email address below. Please enter a valid email address Subscribe by Stan Gibson Stan Gibson is an award-winning technology editor, writer, and speaker, with 36 years of experience covering information technology. Formerly executive editor at eWeek and PC Week, he is currently principal at Stan Gibson Communications, where he continues to write and speak about all aspects of IT. MORE FROM THIS AUTHOR * feature CIOS SEEK EFFICIENCIES AS UNCERTAIN ECONOMY LOOMS By Stan Gibson May 23, 2023 9 mins IT StrategyBudgetingCloud Computing * feature CRAFTING IT INNOVATION STRATEGIES FOR REAL-WORLD VALUE By Stan Gibson Apr 10, 2023 11 mins Generative AIInnovation * feature DYNAMIC TALENT SOURCING GAINS TRACTION FOR FILLING SKILLS NEEDS By Stan Gibson Feb 01, 2023 8 mins HiringStaff Management MOST POPULAR AUTHORS * Sarah K. White Senior Writer * Thor Olavsrud Senior Writer * Peter Sayer Senior Editor SHOW ME MORE PopularArticlesPodcastsVideos brandpost TURNING CYBER RISK INTO BUSINESS RESILIENCE Jul 31, 20235 mins Cyberattacks opinion SIMPLIFYING IT STRATEGY: HOW TO AVOID THE ANNUAL PLANNING PANIC By Michael Bertha Jul 31, 20236 mins IT Strategy brandpost STACK OVERFLOW ANNOUNCES OVERFLOWAI Jul 31, 20237 mins Artificial Intelligence podcast CIO LEADERSHIP LIVE ASEAN WITH ALLAN WONG, DIRECTOR OF INFORMATION TECHNOLOGY, HONG KONG BAPTIST UNIVERSITY Jul 26, 202319 mins CIO Leadership Live podcast CARGILL’S JENNIFER HARTSOCK, CHIEF INFORMATION AND DIGITAL OFFICER, ON ELEVATING DIGITAL AND DATA STRATEGIES Jul 26, 202361 mins CIO Leadership Live podcast CIO LEADERSHIP LIVE WITH JOHN COMACCHIO, SENIOR VICE PRESIDENT AND CIO, TEKNION CORP.: PART 1 Jul 26, 202320 mins CIO Leadership Live video CIO LEADERSHIP LIVE ASEAN WITH ALLAN WONG, DIRECTOR OF INFORMATION TECHNOLOGY, HONG KONG BAPTIST UNIVERSITY Jul 26, 202319 mins CIO Leadership Live video CARGILL’S JENNIFER HARTSOCK, CHIEF INFORMATION AND DIGITAL OFFICER, ON ELEVATING DIGITAL AND DATA STRATEGIES Jul 26, 202361 mins CIO Leadership Live video 3 LEADERSHIP TIPS: SARA FENWICK, VICE PRESIDENT, BUSINESS TECHNOLOGY, REN'S PETS Jul 26, 20231 mins CIO Leadership Live Sponsored Links * dtSearch® - INSTANTLY SEARCH TERABYTES of files, emails, databases, web data. 25+ search types; Win/Lin/Mac SDK; hundreds of reviews; full evaluations * There's a new hybrid cloud agenda. HPE has the playbook for success. Learn more here. * Connect With CIOs & IT Executives At Gartner IT Symposium/ Xpo™ 2023 About * About Us * Advertise * Contact Us * Foundry Careers * Reprints * Newsletters * BrandPosts Policies * Privacy Policy * Cookie Policy * Member Preferences * About AdChoices * Your California Privacy Rights * Privacy Settings Our Network * Computerworld * CSO * Infoworld * Network World * LinkedIn * Twitter * Facebook Copyright © 2023 IDG Communications, Inc.