Tag Archives: chatgpt

Enterprise AI Has a Token Cost Problem — But It’s Very Fixable. What most AI vendors aren’t telling you.

By Larry Gill

The promise of AI in the enterprise is everywhere right now. Every eDiscovery vendor, legal tech platform, and cloud provider is claiming to have AI capabilities. But there’s a fundamental architectural flaw in how virtually every one of them applies AI — and it’s a problem that has significant consequences for your costs, your security, and your risk posture.

With our new release of X1 Enterprise v6, we’ve built a genuinely different approach. Last week, our team hosted a live product tour to walk through what that looks like in practice. Here’s a summary of what we covered — and why I believe it changes everything.

The Problem: AI Is Being Applied Too Late
The eDiscovery and data governance workflow has been largely the same for over 20 years: Identify → Collect → Process → Host → Review. Every major vendor with AI capabilities today is applying AI at the very end of that process — at the Review stage — after data has already been moved or copied into their platform.

That’s too late. And it’s not just where they’re applying AI in the workflow — it’s how they’re applying it that’s the real problem.

Before AI ever touches your data in these platforms, you’ve already:
• Copied and transferred sensitive enterprise information to a vendor-controlled environment
• Paid for processing and hosting on the full data volume — including everything that turns out to be irrelevant
• Created security and compliance exposure from that mass data transfer to a third party
• Waited through long, throttled ingestion cycles before any analysis can begin

And now you’re being up-charged for ‘new’ AI capabilities on top of already expensive collection, hosting, and review fees. And the reason why you are being charged so much is that many of these vendors are merely brokering usage (and being charged for it) through large, centralized AI platforms.

If you’re considering pointing a cloud LLM — Claude, Copilot, ChatGPT, or even legal-focused platforms like Harvey — directly at your enterprise data to solve this problem, I want to be direct: they’re the wrong tool for the job. Cloud AI platforms cannot search data in-place. If you try to use them across your full enterprise data estate, you’ll be exfiltrating enormous volumes of data to their AI engines and consuming a massive number of tokens — exploding your costs in the process.

Infographic illustrating X1's approach to applying AI at the source before data moves, featuring steps: Identify, Collect, Process, Host, and Review.

X1’s Answer: AI In-Place, Before Anything Moves
X1 Enterprise v6 takes a fundamentally different architectural approach. We call it AI In-Place.

Rather than copying data into a centralized platform and then applying AI, X1 deploys distributed micro-indexes directly across your enterprise data sources — your M365 environment, endpoints, cloud repositories, and more. Your data stays exactly where it lives. We bring the AI to the data. Not the other way around.

That means AI decisioning happens before collection, before review-set creation, before any exporting, and before anything moves. We apply AI at the very beginning of the eDiscovery and data governance workflow — not at the end.

X1’s AI capabilities are about upstream AI enablement, not (yet another) prompt-wrapper that brokers expensive queries to Anthropic or OpenAI like too many other eDiscovery and Compliance Platforms. X1’s fundamental architectural shift means X1 neither charges nor incurs OEM AI costs, as the models are frozen and deployed in-place. This factor alone results in massive cost savings and efficiencies.

Infographic comparing two data architectures: 'Collect-First' process showing bulk copy and transfer methods, and 'Analyze-In-Place' by X1 featuring AI capabilities for data analysis in real-time.

One Platform, Across Every Critical Use Case
The AI In-Place architecture isn’t a point solution. It’s an enterprise platform that spans your most critical data workflows:

eDiscovery — X1 enables index-in-place early case assessment, data identification, and highly targeted collection. You get full data visibility and AI-powered responsiveness scoring before a single document is exported, resulting in dramatically smaller review volumes and lower costs — beginning before collection even starts.

Risk and Compliance — X1 identifies and remediates PCI, PII, and privacy-regulated data across your enterprise, continuously and without moving it into a compliance platform. It supports departed employee workflows, GDPR, FOIA, HIPAA compliance, and more — all analyzed and remediated in-place.

InfoSec and Investigations — When a breach occurs or an insider threat is suspected, time is critical. X1 gives investigation teams real-time capability at petabyte scale, across endpoint and cloud environments simultaneously — something no centralized architecture can match.

Information Governance — X1 handles large-scale data separation for M&A due diligence and divestitures, ROT analysis, records management policy enforcement, data mapping, and more — all in-place without migration or centralized data processing.

A Hidden Cost Nobody Is Talking About: Enterprise-Wide Token Explosion
There’s another dimension to this problem that rarely gets discussed openly, and it has major financial implications for any organization deploying AI at scale.

AI productivity tools like Claude or Copilot are genuinely valuable for administrative and day-to-day workflows — drafting emails, summarizing meetings, and generating content. But they are fundamentally the wrong tool for enterprise-wide data discovery.

Here’s why:

When you ask a cloud AI platform to find information across your enterprise data, it has no index to work from. It must retrieve and read the actual documents — potentially thousands or millions of them — just to locate what you’re looking for. Every document pulled into context consumes tokens. Every search, every query, every time someone asks a question about your data, the AI is ingesting enormous volumes of content to produce an answer. At enterprise scale, this doesn’t just add up — it explodes.

The costs compound quickly. Token pricing is consumption-based, and when your AI tool is reading entire document sets on every query rather than looking up a precise answer, you are essentially paying to re-read your entire data estate over and over again. For large organizations, this can translate into AI infrastructure costs that are orders of magnitude higher than they need to be.

X1’s local index-in-place technology solves this directly. Because X1 has already built a persistent, AI-enriched index across all your enterprise data sources — right where the data lives — your AI tools don’t need to go find and read the documents. Instead, the AI asks the question, X1 uses its index to identify the precise answer, and then delivers only the targeted files, documents, or data points the AI or end user actually needs. The documents themselves never have to be ingested into the AI platform at all.

The result is dramatically lower token consumption across your organization — because you’re sending the AI targeted answers, not raw document libraries. X1 becomes the intelligent retrieval layer that makes your existing AI investments far more efficient and far less expensive to operate at scale.

Where We’re Headed: X1 as the Governed Retrieval Layer for Enterprise AI
As your organization deploys more AI assistants and agents — through Copilot, Claude, or internal AI tools — they will all need a secure, governed way to retrieve knowledge from your distributed data. X1 is being built to serve as that infrastructure layer that connects your AI tools to your data.

Our vision is for X1 to become the MCP Server for your LLMs — the governed retrieval layer that sits between your centralized AI systems and your enterprise data. Your AI tools will ask the questions. X1 will find and provide the answers — safely, compliantly, at scale, with minimal cost, and without data ever leaving its source.

Three Things I Want You to Take Away

  1. AI In-Place gives you a real strategic advantage. Security, speed, and scalability — at a fraction of the cost — with your data never leaving your environment. There’s no need to collect, move, copy, re-index, or centralize before analysis can begin. The shortest path to insight is leaving the data where it already is.
  2. We will never monetize your data. Full stop. You can analyze your data in place and pay nothing extra for the AI capabilities we’ve built into v6. No data charges. No add-on fees. Ever. Your data is an asset — it shouldn’t be a revenue stream for your software vendor.
  3. Control belongs with you. This industry has been charging customers a premium for over-collection, over-processing, bloated hosting, inefficient review, and now AI add-on fees on top of it all. That model ends here. X1’s AI-native approach cuts through it entirely — dramatically lower costs, no unnecessary data sprawl, and control back where it belongs.

If you missed the webinar, you can watch it now here. And if you’d like to see what AI In-Place looks like in your specific environment — your M365 footprint, your eDiscovery program, your compliance posture — reach out to us at info@x1.com or visit x1.com to schedule a private demo.

The right architecture for AI isn’t about moving your data to the AI. It’s about bringing the AI to your data.”
— Larry Gill, CEO, X1 Discovery

Leave a comment

Filed under Best Practices, Cloud Data, Corporations, Cybersecurity, Data Audit, Data Governance, ECA, eDiscovery & Compliance, Enterprise AI, Enterprise eDiscovery, ESI, GDPR, Information Governance, Information Management

Why X1’s AI In-Place Architecture Is a Genuine Departure from Legal AI’s Status Quo

By John Patzakis

X1 AI In-Place Architecture — AI hub connecting to distributed enterprise data sources including Microsoft 365, email, cloud, and endpoints

The legal technology market has a buzzword problem. Terms like “AI-powered,” “intelligent review,” and “automated analysis” have been applied so broadly—and so inconsistently—that they have largely lost their ability to signal anything meaningful about how a product actually works. Against that backdrop, X1’s announcement last week of AI In-Place for X1 Enterprise represents a genuinely different approach to applying AI within enterprise legal and compliance workflows. The reason for this basis is X1’s unique architecture.

To understand why, it helps to start with the dominant model that most legal AI tools share. The overwhelming majority of AI-enabled eDiscovery and governance platforms are built on a collect-first assumption: data must be moved out of its native environment—copied, ingested, centralized in a vendor-controlled repository—before any AI model can be applied to it. This is not an incidental design choice; it reflects the fundamental architecture of how most of these platforms were built, long before AI became part of the product story. The result is what practitioners have come to call the “prompt wrapper” problem: an AI interface sits in front of a conventional data pipeline, and the underlying mechanics—the cost, the risk, the latency—remain largely unchanged. A large language model with a “middleware” workflow does not solve the structural problem of what happens to sensitive data before the AI touches it.

X1’s AI In-Place architecture inverts that assumption. Rather than requiring data to travel to an AI system, X1’s patented distributed micro-indexing technology deploys AI models directly into lightweight micro-indexes at the data source itself—across Microsoft 365 environments, file shares, cloud repositories, and endpoints. The AI executes where the data lives, and the data does not move. The implications run across multiple dimensions: data never leaves the enterprise perimeter, security policies and endpoint controls remain intact throughout the process, and the computational overhead and massive AI token costs associated with large-scale data ingestion is avoided entirely. For matters involving a terabyte of data or more—where centralized collection is not merely expensive but operationally infeasible—this architectural distinction is not incremental. It changes what is actually possible.

The workflow mechanics reinforce the point. AI models are deployed into X1’s distributed micro-indexes behind the firewall, execute against enterprise data in place, and surface AI-enriched insights—tags, classifications, risk scores—into a central console without the underlying data ever being collected or copied. That means targeted collection decisions, early case assessment, and information governance actions can be driven by AI-informed analysis conducted across the full enterprise data landscape, not just against a subset of data that has already been moved. The distinction matters because the scope of analysis in the collect-first model is constrained by collection costs; in the in-place model, analysis scope is no longer tethered to collection volume. Investigations and governance programs can, in principle, cast a much wider net analytically while actually reducing the volume of data that requires review.

Mandi Ross, CEO of Insight Optix, offered a perspective that cuts to the core of what makes this architecture commercially significant: “Enabling AI directly where the clients’ data resides fundamentally changes the economics, speed, and risk profile of enterprise data discovery, investigations and compliance workflows. With X1 Enterprise AI In-Place, we can deploy AI models, pre-trained or customized for specific matters, data queries, or compliance requirements—securely within client environments, dramatically accelerating time to insight without sensitive information being collected, duplicated, or centralized outside their control.”

Ross identifies three dimensions the in-place approach changes: economics, speed, and risk. On economics, a significant lever is the reduction in review population size—AI-informed pre-collection filtering means fewer documents proceed to human review. Additionally, costs associated with collection and processing, including expensive AI token utilization, are all but eliminated. On speed, running analysis in situ, without waiting for collection and ingestion cycles, compresses time to first insight—critical in time-sensitive investigations and regulatory responses. On risk, data that does not move cannot be breached in transit, does not reside in vendor infrastructure outside the client’s control, and does not generate the compliance exposure of large-scale cross-boundary transfers. Her comment reflects what experienced practitioners understand but marketing language tends to obscure: the most consequential question about any legal AI tool is not what the AI does, but what happens to the data before and during its operation.

The enterprise deployment model reflects design discipline that distinguishes AI In-Place from retrofitted solutions. Organizations retain centralized governance over AI usage while processing remains local under existing security policies and endpoint controls. AI capabilities are fully optional and configurable at the data source level—important for organizations operating across multiple jurisdictions with differing regulatory requirements—and customer data is never used to train, fine-tune, or enrich underlying AI models, addressing a standard due diligence concern in enterprise AI procurement.

The practical use case implications are significant across several domains. In legal and eDiscovery contexts, in-place TAR and pre-collection analytics allow AI-informed decisions about what to collect before collection begins, directly reducing review volumes and costs. In information governance, AI-driven classification and policy enforcement can operate continuously across the full enterprise data estate rather than against periodic snapshots, enabling more responsive and defensible governance programs. In security and investigations, real-time insider risk detection at petabyte scale—across endpoint and cloud environments simultaneously—becomes feasible where centralized architectures make it impractical. In each case, analytical scope is no longer constrained by collection logistics.

Most legal AI products apply AI to data after it has already moved through the conventional collection pipeline. AI In-Place asks a more fundamental question: whether the pipeline itself should be reconceived. We will demonstrate it live on Wednesday, June 24—for those evaluating enterprise AI in legal, compliance, or governance contexts, it is worth seeing what a genuinely different architecture looks like in practice.

Register for the June 24 AI In-Place™ Product Tour →

Leave a comment

Filed under Best Practices, Cloud Data, Corporations, Cybersecurity, Data Audit, Data Governance, ECA, eDiscovery & Compliance, Enterprise AI, Enterprise eDiscovery, Enterprise Search, ESI, GDPR, Information Access, Information Governance, Information Management, m365, MS Teams, OneDrive, SharePoint

Bringing AI to the Data: How X1 Search v11 Redefines Secure Enterprise Search

By John Patzakis

At X1, we believe the future of enterprise AI depends on a simple but often overlooked principle: data should not have to move in order to become intelligent. With the launch of X1 Search v11, we are introducing a fundamentally different approach—one that embeds AI directly into our index-in-place architecture. Rather than forcing organizations to centralize and copy their data into external platforms, we enable AI to operate exactly where that data already lives. You can read the full press release here: https://www.x1.com/x1-introduces-ai-powered-x1-search-delivering-secure-ai-in-place-for-individual-and-enterprise-users/

This release represents an important milestone for us and for our customers. As Chas Meier noted, “X1 Search v11 marks an important milestone in how organizations can safely apply AI…without compromising the security controls enterprise environments demand.” That statement reflects our core design philosophy: AI must adapt to enterprise security, compliance, and governance requirements—not the other way around.

With X1 Search v11, we are delivering AI capabilities directly within our micro-index. That means organizations can apply advanced intelligence—classification, categorization, and contextual analysis—across emails, files, and collaboration data without ever relocating that information. Everything happens in place, within existing security boundaries, whether on endpoints or across enterprise systems.

For large enterprises, this architecture unlocks an even more powerful capability: the ability to deploy their own trained and curated large language models directly into the X1 index. Instead of relying solely on generic, hosted AI services, organizations can operationalize models tailored to their data that reflect their internal policies, regulatory requirements, and business workflows. These models run directly against their data, in place, delivering highly relevant and controlled outcomes.

This approach stands in sharp contrast to traditional hosted AI platforms. In those models, organizations must copy and transfer massive amounts of sensitive data into third-party hosted AI platforms before any meaningful analysis can occur. That process introduces serious risks. Moving data to outside providers complicates compliance, potentially compromises IP, and creates new attack surfaces that most enterprises simply cannot accept.

Beyond security concerns, the traditional model also breaks down operationally at scale. Enterprises are not dealing with small data sets; they are managing dozens of terabytes of distributed, unstructured data. Attempting to duplicate and transfer that volume is not just costly; it is infeasible. The result is delays, fragmentation, and incomplete analysis—undermining the very promise of AI.

We have taken a different path. By bringing AI to the data through our distributed micro-indexing technology, we eliminate the need for data movement entirely. Models can be deployed directly to where data resides, enabling real-time analysis while preserving security, reducing infrastructure overhead, and scaling seamlessly across the enterprise.

We see X1 Search v11 as more than a product release—it is a shift in how enterprise AI is deployed. Organizations no longer have to choose between innovation and control. With AI in place, they can achieve both.

To see this in action, we invite you to join our upcoming live product tour on Thursday, April 23, providing a guided walkthrough of the new AI-enriched capabilities and flexible model deployment features.

Leave a comment

Filed under Best Practices, Business Productivity Search, Desktop Search, Enterprise AI, Enterprise eDiscovery, Enterprise Search, ESI, Google Workspace, Information Access, Information Management, m365, MS Teams, X1 Search 11

X1 Brings “AI In-Place” to the Enterprise—A Major Breakthrough for Secure, Scalable AI Deployment

By John Patzakis

Our latest announcement represents a true inflection point in enterprise AI. With X1 Enterprise’s newly introduced capability for AI in-place, organizations and their service providers will, for the first time, be able to deploy and execute large language models (LLMs) directly where enterprise data lives—without moving or copying that data.

This is more than a product enhancement; it is a fundamental shift in how AI is applied across the enterprise.

The Foundation: Efficient Text Extraction Is Critical for AI
Large language models (LLMs) are the core engines that power today’s AI revolution. These models rely entirely on textual input to perform reasoning, summarization, search, and analysis. That is why text extraction is the critical first step. LLMs can only operate once another process extracts the text from emails, documents and chats. Traditionally, that meant copying or exporting data to external systems hosted by third party vendors, a process fraught with risk, cost, and compliance challenges.

Solving the “Data Movement Problem” for Enterprise AI
So, the key barrier to enterprise AI adoption has been the reluctance to move sensitive corporate data to external AI platforms. Whether for security, governance or cost reasons, most enterprises simply cannot send their data outside their environment.

X1’s innovation solves that problem head-on. Instead of shipping sensitive data out to an AI system, X1 brings the AI to the data. Enterprises can now deploy their own proprietary models or open-source LLMs within the secure perimeter of their existing infrastructure, whether on premises or in the cloud. X1’s index-in-place architecture performs the text extraction and indexing where the data resides. By extending that same principle to AI—forward-deploying LLMs directly to enterprise data sources—X1 now enables AI in-place. The result: organizations can apply the analytical power of LLMs across their data without ever moving it.

Once the LLMs are deployed into the X1 micro-indexes, X1 will then auto-apply AI-informed tags, which a user can query globally from a central console and act upon through targeted data collection or remediation. Imagine petabytes of data on file servers, laptops M365 and other sources all AI-classified and then queried and collected on a highly targeted basis.

This means enterprises can now unlock powerful new use cases no matter the scale—AI-assisted compliance, risk monitoring, GRC audits, eDiscovery, and more—while maintaining full control of their data and eliminating the need for costly, risky data transfers.

Enabling Collaboration Between Enterprises and Their Advisors
William Belt, Managing Director and Consulting Practice Leader at Complete Discovery Source, described the impact succinctly:

“Enabling AI in-place where our corporate client’s data lives is game-changing. We look forward to working with our clients to deploy AI models that are either pre-trained or customized for a specific matter or compliance requirement utilizing the X1 Enterprise platform.”

This capability creates a new bridge between corporations and their professional advisors—consulting firms, law firms, and service providers—who can now collaborate directly with their clients to develop, fine-tune, and deploy customized AI models for specific business or legal needs.

Rather than relying on generic cloud-based AI tools, organizations can now build targeted, matter-specific LLMs that are tuned to their unique data and compliance requirements, all executed securely in-place through the X1 Enterprise Platform.

A New Era for Enterprise AI
With this release, X1 is redefining the architecture of enterprise AI. Its ability to perform distributed micro-indexing and in-place AI analysis across global data sources enables secure, scalable, and cost-effective intelligence—without ever duplicating or relocating sensitive data.

For enterprises and their partners, this represents a new era of possibility: true AI at enterprise scale, in-place.

X1 will host a webinar on Wednesday, December 10, featuring a detailed overview of this new capability and a live demonstration. You can register here.

Leave a comment

Filed under Cloud Data, Corporations, Cybersecurity, eDiscovery, eDiscovery & Compliance, Enterprise AI, Enterprise eDiscovery, Information Governance, m365