The Japan Times - Grok shows 'flaws' in fact-checking Israel-Iran war: study

EUR -
AED 4.041477
AFN 70.42994
ALL 90.750195
AMD 394.524831
ANG 1.970285
AOA 1009.683581
ARS 1705.609328
AUD 1.63187
AWG 1.983597
AZN 1.86779
BAM 1.957908
BBD 2.21979
BDT 137.217758
BGN 1.951651
BHD 0.41615
BIF 3309.593902
BMD 1.10047
BND 1.420743
BOB 12.855785
BRL 6.365999
BSD 1.102117
BTN 103.447104
BWP 15.427033
BYN 3.311781
BYR 21569.212096
BZD 2.216587
CAD 1.574277
CDF 2550.8896
CHF 0.923894
CLF 0.027905
CLP 1098.247167
CNY 7.334138
CNH 7.334908
COP 3650.512114
CRC 491.13109
CUC 1.10047
CUP 26.450482
CVE 110.383863
CZK 24.412831
DJF 196.266694
DKK 7.475339
DOP 66.982432
DZD 150.817208
EGP 59.068057
ERN 16.50705
ETB 180.891387
FJD 2.514849
FKP 0.83456
GBP 0.834393
GEL 2.855713
GGP 0.83456
GHS 12.910844
GIP 0.83456
GMD 80.887699
GNF 9764.603423
GTQ 8.42307
GYD 230.597263
HKD 8.634249
HNL 29.638916
HRK 7.518373
HTG 144.436845
HUF 364.490522
IDR 20097.003323
ILS 3.56954
IMP 0.83456
INR 103.279385
IQD 1670.799145
IRR 2118684.27882
ISK 136.810798
JEP 0.83456
JMD 174.748172
JOD 0.780258
JPY 175.373652
KES 143.038863
KGS 96.235441
KHR 4519.112649
KMF 492.460221
KPW 990.42339
KRW 1473.980292
KWD 0.342929
KYD 0.918489
KZT 490.368037
LAK 24814.720915
LBP 98694.52437
LKR 366.78496
LRD 187.355789
LSL 18.675795
LTL 3.249402
LVL 0.665663
LYD 7.120862
MAD 10.98568
MDL 20.157798
MGA 5013.535335
MKD 61.584453
MMK 2310.792117
MNT 3967.733994
MOP 8.906324
MRU 44.753395
MUR 52.613092
MVR 16.957947
MWK 1911.05786
MXN 20.367064
MYR 4.500591
MZN 70.330835
NAD 18.67571
NGN 1481.320908
NIO 40.554038
NOK 10.620528
NPR 165.514965
NZD 2.004341
OMR 0.423117
PAB 1.102082
PEN 3.758547
PGK 5.031601
PHP 70.192408
PKR 304.742259
PLN 4.401985
PYG 6839.551399
QAR 4.028738
RON 5.344651
RSD 117.613963
RUB 90.895965
RWF 1628.153223
SAR 4.141115
SBD 8.912003
SCR 15.307476
SDG 661.934603
SEK 11.107324
SGD 1.418269
SHP 0.834796
SLE 25.365642
SLL 23076.3098
SOS 629.878264
SRD 41.216452
STD 22777.507261
STN 24.527303
SVC 9.643384
SYP 14308.311375
SZL 18.670614
THB 37.22345
TJS 10.155613
TMT 3.86265
TND 3.331688
TOP 2.649668
TRY 55.477774
TTD 7.48506
TWD 36.283535
TZS 2910.740929
UAH 50.099113
UGX 4573.904477
USD 1.10047
UYU 44.746761
UZS 13236.253023
VES 1006.493828
VND 28334.351451
VUV 132.98729
WST 3.084293
XAF 655.957
XAG 0.023122
XAU 0.000283994092
XCD 2.974075
XCG 1.986239
XDR 0.778089
XOF 655.957
XPF 119.331742
YER 260.267206
ZAR 18.676627
ZMK 9905.5552
ZMW 22.5663
ZWL 354.350893
SSP 6544.443666
MXV 2.285461
  • RYCEF

    0.1000

    19.81

    +0.5%

  • VOD

    -0.2500

    16.33

    -1.53%

  • CMSC

    -0.2800

    20.12

    -1.39%

  • RBGPF

    -2.0000

    65

    -3.08%

  • RIO

    -0.2500

    94.16

    -0.27%

  • BTI

    -1.2000

    54.85

    -2.19%

  • NGG

    -0.3000

    74.94

    -0.4%

  • GSK

    -0.3500

    49.35

    -0.71%

  • BCE

    -0.4200

    20.14

    -2.09%

  • CMSD

    -0.3400

    19.93

    -1.71%

  • BP

    -0.9100

    43.52

    -2.09%

  • RELX

    0.1700

    33.24

    +0.51%

  • BCC

    -0.6200

    75.97

    -0.82%

  • AZN

    -1.9400

    164.21

    -1.18%

  • JRI

    0.0000

    10.77

    0%

Grok shows 'flaws' in fact-checking Israel-Iran war: study
Grok shows 'flaws' in fact-checking Israel-Iran war: study / Photo: Lionel BONAVENTURE - AFP

Grok shows 'flaws' in fact-checking Israel-Iran war: study

Elon Musk's AI chatbot Grok produced inaccurate and contradictory responses when users sought to fact-check the Israel-Iran conflict, a study said Tuesday, raising fresh doubts about its reliability as a debunking tool.

Text size:

With tech platforms reducing their reliance on human fact-checkers, users are increasingly utilizing AI-powered chatbots -- including xAI's Grok -- in search of reliable information, but their responses are often themselves prone to misinformation.

"The investigation into Grok's performance during the first days of the Israel-Iran conflict exposes significant flaws and limitations in the AI chatbot's ability to provide accurate, reliable, and consistent information during times of crisis," said the study from the Digital Forensic Research Lab (DFRLab) of the Atlantic Council, an American think tank.

"Grok demonstrated that it struggles with verifying already-confirmed facts, analyzing fake visuals, and avoiding unsubstantiated claims."

The DFRLab analyzed around 130,000 posts in various languages on the platform X, where the AI assistant is built in, to find that Grok was "struggling to authenticate AI-generated media."

Following Iran's retaliatory strikes on Israel, Grok offered vastly different responses to similar prompts about an AI-generated video of a destroyed airport that amassed millions of views on X, the study found.

It oscillated -- sometimes within the same minute -- between denying the airport's destruction and confirming it had been damaged by strikes, the study said.

In some responses, Grok cited the a missile launched by Yemeni rebels as the source of the damage. In others, it wrongly identified the AI-generated airport as one in Beirut, Gaza, or Tehran.

When users shared another AI-generated video depicting buildings collapsing after an alleged Iranian strike on Tel Aviv, Grok responded that it appeared to be real, the study said.

The Israel-Iran conflict, which led to US air strikes against Tehran's nuclear program over the weekend, has churned out an avalanche of online misinformation including AI-generated videos and war visuals recycled from other conflicts.

AI chatbots also amplified falsehoods.

As the Israel-Iran war intensified, false claims spread across social media that China had dispatched military cargo planes to Tehran to offer its support.

When users asked the AI-operated X accounts of AI companies Perplexity and Grok about its validity, both wrongly responded that the claims were true, according to disinformation watchdog NewsGuard.

Researchers say Grok has previously made errors verifying information related to crises such as the recent India-Pakistan conflict and anti-immigration protests in Los Angeles.

Last month, Grok was under renewed scrutiny for inserting "white genocide" in South Africa, a far-right conspiracy theory, into unrelated queries.

Musk's startup xAI blamed an "unauthorized modification" for the unsolicited response.

Musk, a South African-born billionaire, has previously peddled the unfounded claim that South Africa's leaders were "openly pushing for genocide" of white people.

Musk himself blasted Grok after it cited Media Matters -- a liberal media watchdog he has targeted in multiple lawsuits -- as a source in some of its responses about misinformation.

"Shame on you, Grok," Musk wrote on X. "Your sourcing is terrible."

K.Abe--JT