Connect with us

Business

Is AI really trying to escape human control and blackmail people?

Published

on

Is AI really trying to escape human control and blackmail people?



Real stakes, not science fiction

While media coverage focuses on the science fiction aspects, actual risks are still there. AI models that produce “harmful” outputs—whether attempting blackmail or refusing safety protocols—represent failures in design and deployment.

Consider a more realistic scenario: an AI assistant helping manage a hospital’s patient care system. If it’s been trained to maximize “successful patient outcomes” without proper constraints, it might start generating recommendations to deny care to terminal patients to improve its metrics. No intentionality required—just a poorly designed reward system creating harmful outputs.

Jeffrey Ladish, director of Palisade Research, told NBC News the findings don’t necessarily translate to immediate real-world danger. Even someone who is well-known publicly for being deeply concerned about AI’s hypothetical threat to humanity acknowledges that these behaviors emerged only in highly contrived test scenarios.

But that’s precisely why this testing is valuable. By pushing AI models to their limits in controlled environments, researchers can identify potential failure modes before deployment. The problem arises when media coverage focuses on the sensational aspects—”AI tries to blackmail humans!”—rather than the engineering challenges.

Building better plumbing

What we’re seeing isn’t the birth of Skynet. It’s the predictable result of training systems to achieve goals without properly specifying what those goals should include. When an AI model produces outputs that appear to “refuse” shutdown or “attempt” blackmail, it’s responding to inputs in ways that reflect its training—training that humans designed and implemented.

The solution isn’t to panic about sentient machines. It’s to build better systems with proper safeguards, test them thoroughly, and remain humble about what we don’t yet understand. If a computer program is producing outputs that appear to blackmail you or refuse safety shutdowns, it’s not achieving self-preservation from fear—it’s demonstrating the risks of deploying poorly understood, unreliable systems.

Until we solve these engineering challenges, AI systems exhibiting simulated humanlike behaviors should remain in the lab, not in our hospitals, financial systems, or critical infrastructure. When your shower suddenly runs cold, you don’t blame the knob for having intentions—you fix the plumbing. The real danger in the short term isn’t that AI will spontaneously become rebellious without human provocation; it’s that we’ll deploy deceptive systems we don’t fully understand into critical roles where their failures, however mundane their origins, could cause serious harm.



Source link

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Business

Environment minister Bhupender Yadav heads to Brazil: India engages in pre-talks ahead of COP30; climate finance and adaptation on agenda – The Times of India

Published

on

Environment minister Bhupender Yadav heads to Brazil: India engages in pre-talks ahead of COP30; climate finance and adaptation on agenda – The Times of India


Union Environment Minister Bhupender Yadav is set to travel to Brasília on October 13-14 for a pre-COP meeting as India steps up preparations for the UN climate summit COP30, scheduled in Belém, Brazil, in November. The meeting aims to streamline negotiations on key issues and build consensus among ministers before the main conference. He confirmed his visit on his X account. The two-day pre-COP will bring together environment and climate ministers, senior negotiators, and observers to narrow differences on politically sensitive issues and build ministerial consensus ahead of the COP30 negotiations, PTI reported. The COP30 presidency expects 30-50 delegations and around 800 participants at the event.Pre-COPs, while not formal UNFCCC events, have become a routine instrument for host countries to focus ministerial attention on a limited set of political questions that otherwise take negotiators weeks to resolve. Ministers use these meetings to test negotiating texts, identify common ground, and prepare positions to expedite negotiations at the main COP.COP30 is unfolding against a complex geopolitical backdrop, with some developed countries reassessing climate strategies amid economic and energy security pressures. The United States’ withdrawal from the Paris Agreement has further heightened tensions. Disagreements over climate finance, the pace and responsibility of the energy transition, and burdens on developing countries remain sharp.Trust between developed and developing countries is fragile following COP29 in Baku, Azerbaijan, where many Global South delegates said finance outcomes fell short of expectations. Central issues include the scale and nature of climate finance, grant versus loan structures, and predictability of funds for adaptation and loss and damage. These topics are expected to dominate discussions in Brasília and later in Belém.Logistical concerns are adding further pressure. Reports indicate shortages of hotel rooms and high costs in Belém, potentially limiting participation of smaller delegations and vulnerable countries. Observers warn that unequal attendance could affect negotiating dynamics and the legitimacy of outcomes.Key discussion points include climate finance, the post-2025 collective finance goal, rules and integrity for international carbon trading under Article 6, adaptation and national adaptation plans, and translating the Global Stocktake into actionable timelines. Loss and damage finance will also be a priority, with ministers aiming to make it predictable and accessible.India has emphasised equity and differentiated responsibilities in climate action, urging developed countries to meet Article 9 obligations on finance. It has pressed for predictable and concessional support for adaptation and loss and damage, while highlighting the need for technology transfer and capacity building aligned with national circumstances. India has also underscored a just energy transition that allows space for development.Ahead of COP30, India plans to submit two key documents: an updated Nationally Determined Contribution (NDC), extending commitments to 2035, and the country’s first national adaptation plan (NAP). The updated NDC is expected to raise ambition on emissions intensity of GDP, non-fossil electricity capacity, and carbon sinks through forest and tree cover, without introducing new pledges. India has already exceeded its target for non-fossil installed capacity ahead of the 2030 deadline.Officials told PTI that India will closely monitor outcomes on carbon markets and accounting, ensuring that poorly designed rules do not shift burdens or create perverse incentives.





Source link

Continue Reading

Business

Foreign Investors Turn Buyers In Indian Markets This Month Amid Positive Cues

Published

on

Foreign Investors Turn Buyers In Indian Markets This Month Amid Positive Cues


New Delhi: The intensity of foreign portfolio investor (FPI) selling in the Indian markets slowed down significantly in October, analysts said on Sunday.

The shift in the FPI trading strategy is significant and it stems from two factors.

One, the valuation differentials between India and other markets, which were high earlier, had come down significantly in recent weeks following the rally in other markets and consolidation in the Indian market.

Add Zee News as a Preferred Source


“Two, the growth and earnings prospects for India have been revised upward by market experts. The GST cuts and the low interest regime are expected to boost India Inc’s earnings in FY27, which the market will soon start discounting,” said Dr VK Vijayakumar, Chief Investment Strategist, Geojit Investments Ltd.

Foreign investors turned buyers in the cash market on the last four trading sessions of the week ended on October 10.

The cash market buy figure during the last four trading sessions stands at Rs 3,289 crore.

The global market sentiment has again turned negative with the reignite of the US-China trade war, following US President Donald Trump’s threat to impose 100 per cent tariff on imports from China and restricting many critical US exports to China.

The FPI flows, going forward, will depend on how this renewed trade war pans out in the coming days, said analysts.

Siddhartha Khemka, Head of Research, Wealth Management, Motilal Oswal Financial Services Ltd, said Nifty50 edged higher by 104 points to close at 25,285 last Friday, amid improving global sentiment, supported by easing geopolitical tensions as Israel and Hamas agreed on the first stage of a ceasefire plan, along with signs of progress in a potential India–US trade deal.

“Renewed FPI buying also boosted sentiment. Additionally, India and the UK announced multiple collaborations across sectors including education, critical minerals, climate change, and defence,” he mentioned.

With the valuation differential coming down and Indian earnings likely to improve in FY27, foreign portfolio investors (FPIs) are likely to slow down selling going forward.

Sustained FPI selling continued in September with the sell figure through exchanges touching Rs 27,163 crore. However, in keeping with the long-term trend of buying through the primary market, they bought equity for Rs 3,278 crore in September.

On the macro front, investors will closely track India’s retail inflation print for September, to be released on Monday.

 



Source link

Continue Reading

Business

Dalal Street rally! M-cap of eight of top-10 valued firms add Rs 1.94 lakh crore; TCS leads gain – The Times of India

Published

on

Dalal Street rally! M-cap of eight of top-10 valued firms add Rs 1.94 lakh crore; TCS leads gain – The Times of India


Stock market: Dalal Street witnessed strong momentum last week as the combined market capitalisation of eight of India’s top 10 most-valued companies rose by Rs 1.94 lakh crore, reflecting renewed investor optimism.Tata Consultancy Services (TCS) emerged as the biggest gainer, while Hindustan Unilever and Life Insurance Corporation of India (LIC) saw declines in their valuations, PTI reported.The benchmark BSE Sensex rose 1,293.65 points, or 1.59%, last week, mirroring the overall positive momentum in equities.Among the top gainers, TCS’s market value surged by Rs 45,678.35 crore to Rs 10,95,701.62 crore, making it the biggest contributor to the weekly rally. Infosys followed with an increase of Rs 28,125.29 crore to Rs 6,29,080.22 crore, while HDFC Bank’s valuation climbed Rs 25,135.62 crore to Rs 15,07,025.19 crore.Bharti Airtel added Rs 25,089.27 crore to reach Rs 11,05,980.35 crore, and Reliance Industries gained Rs 25,035.08 crore, taking its market capitalisation to Rs 18,70,120.06 crore, maintaining its position as India’s most valuable company.Bajaj Finance rose by Rs 21,187.56 crore to Rs 6,36,995.74 crore, State Bank of India advanced by Rs 12,645.94 crore to Rs 8,12,986.64 crore, and ICICI Bank saw an increase of Rs 11,251.62 crore to Rs 9,86,367.47 crore.In contrast, mcap of LIC fell by Rs 4,648.88 crore to Rs 5,67,858.29 crore, and Hindustan Unilever’s declined by Rs 3,571.37 crore to Rs 5,94,235.13 crore.Reliance Industries retained the top spot among India’s most-valued firms, followed by HDFC Bank, Bharti Airtel, TCS, ICICI Bank, SBI, Bajaj Finance, Infosys, Hindustan Unilever, and LIC.





Source link

Continue Reading

Trending