This week, even the most ambitious AI implementations faced the harsh realities of security, efficiency, and trust. The 83,000 Flock Safety cameras deployed spiraled into a total surveillance system, leading to contract terminations and investigations, exposing hidden risks in GovTech projects and eroding municipal trust. This case is a stark reminder of how scaling AI without proper oversight can lead to compliance crises and reputational damage, forcing business leaders to re-evaluate the ethical and legal implications of their AI strategies.

Story of the weekFlock Safety shifted to open-ended AI surveillance and broke municipal trustThe Flock Safety case demonstrates how uncontrolled scaling of AI surveillance systems leads to a crisis of trust and legal issues, forcing businesses to re-evaluate compliance.Read →

Security emerged as a central concern for multi-agent systems. OpenAgentFlow's research revealed that a new architecture can block up to 95.35% of stealth attacks in such systems by controlling data at the action execution boundary. This is critically important for companies integrating AI agents into their operations, as data breaches can result in significant financial and reputational losses. Addressing the issue of "permission laundering" becomes a priority for those building autonomous business processes.

Businesses are ready for AI agents, but not for their risks and high bills.

Meanwhile, the inherent limitations of the models themselves cannot be overlooked. Researchers at the University of Arizona found that in extended dialogues, advanced LLMs exhibit "catastrophic drift," losing logic and chaotically shifting positions. This casts doubt on the effectiveness of large models in tasks requiring prolonged and consistent communication, such as customer support or complex negotiation processes, and requires businesses to seek more stable solutions or adapt their workflows.

AI economics are also evolving, driven by the search for a balance between cost and performance. Fine-tuning 350M parameter micro-models using the GRPO method significantly improved JSON generation accuracy, reducing reliance on expensive GPT-4o level APIs. This opens opportunities for optimizing data processing costs, especially for companies with large volumes of routine requests, and signals a potential shift towards more specialized and cost-effective AI solutions over universal, expensive ones. Overall, the week showed that businesses are increasingly concerned not only with AI adoption but also with its controlled, secure, and economically justifiable scaling.