Trust and verification
How to evaluate AI trading-tool claims before connecting money or a broker
Treat guaranteed returns, fixed win rates, risk-free automation, unexplained “AI,” missing source provenance, hidden costs, pressured deposits, and unclear account permissions as reasons to stop and verify—not as reasons to move faster.
Direct answer
What claims should you distrust when evaluating an AI trading tool?
Distrust any claim that removes uncertainty: guaranteed profits, a fixed or near-perfect win rate, “risk-free” returns, effortless income, or a model that supposedly predicts sudden market changes. Pause when the seller cannot explain what the tool does, identify current sources, show a test methodology with costs, state every account permission, distinguish read-only analysis from order submission, or provide a clear way to revoke access. Verify the company, people, claimed registrations, evidence, total costs, and broker authority independently before connecting an account or funding anything.
Who this checklist is for—and what it cannot decide
This checklist is for self-directed traders comparing research, chart-analysis, pre-trade review, signal, or auto-trading products, especially when a tool may connect to a brokerage account. It helps turn a marketing claim into specific evidence requests.
It cannot certify a provider, determine whether a product is lawful in every jurisdiction, prove that a registered person is trustworthy, or make an investment suitable. Educational software, research tools, investment advisers, brokers, exchanges, and auto-trading services can have different legal roles. Identify the role actually being performed and verify the applicable regulator rather than assuming every trading tool must hold the same registration.
Eight red flags and the evidence to request
The eight-step due-diligence sequence
- Identify the legal entity and role.Record the company name, people, domain, location, custody arrangement, and whether the product claims to provide education, research, advice, brokerage, exchange, signal, or auto-trading services. Verify claimed registrations on the regulator's own site.
- Separate analysis from authority.Write down whether the tool only displays information, reads broker context, drafts an order, or can create, modify, cancel, or transmit an order. Confirm Paper versus Live scope and who performs the final action.
- Interrogate every performance claim.Reject guarantees. For any historical result, require the period, full sample, benchmark, drawdown, losing observations, selection rules, out-of-sample method, and costs. A screenshot or a few winners is not a performance record.
- Test the AI claim.Ask what AI changes, which inputs it uses, how the output was evaluated, what a failure looks like, and when a human must intervene. Product language should match the capability actually implemented.
- Inspect provenance and freshness.Require named sources, timestamps, session and time-frame context, missing-data behavior, and fallbacks. Check consequential information against multiple independent sources.
- Inventory permissions and data.List every credential, account field, order capability, storage location, retention period, subprocessor, and revocation path. Grant the minimum necessary permission and avoid a live account when a paper or sandbox test is available.
- Recalculate after all costs.Include subscriptions, spreads, commissions, slippage, financing, taxes, withdrawal conditions, and the cost of errors. Compare like-for-like periods and do not turn a backtest into a forward promise.
- Run a reversible test.Use a paper, sandbox, or read-only environment first; test access removal and support response; document a stop condition; and independently confirm that revocation worked before considering money or live permissions.
Broker-connection questions for an IBKR user
Before enabling any connection, ask for a one-page permission map. It should answer: What account is visible? Is the session Paper or Live? Which market-data and account fields can be read? Can any order be created, modified, cancelled, or transmitted? Where do credentials remain? What network path is used? How is access revoked? What happens when data is stale, missing, or contradictory?
A read-only connection is a narrower boundary, not proof of accuracy, security, performance, or suitability. Paper trading is also a simulator and does not establish live execution quality. Use the IBKR Paper TWS setup guide to inspect Lumiere's read-only connection boundary and documented simulator limitations.
How Lumiere applies the same checklist
This is a public product-boundary check, not a third-party certification or a claim that Lumiere is risk-free.
Official sources behind this checklist
The following U.S. regulator sources support the red-flag and verification principles above. Their warnings do not establish that a particular product is fraudulent, and they do not replace jurisdiction-specific professional advice.
For one dated illustration, FINRA's July 29, 2025 auto-trading warning described promotions claiming consistent monthly returns of more than 10 percent. That is an example of the promotional language FINRA flagged, not a threshold below which a return claim becomes safe, credible, or suitable.
CFTC source reviewed August 4, 2026: Customer Advisory: AI Won't Turn Trading Bots into Money Machines.
FINRA, SEC, and NASAA source reviewed August 4, 2026: Artificial Intelligence and Investment Fraud.
FINRA source reviewed August 4, 2026: Risks of Auto-Trading Services Offered by Unregistered Entities.
SEC enforcement source reviewed August 4, 2026: SEC Charges Two Investment Advisers with Making False and Misleading Statements About Their Use of Artificial Intelligence.
Investor.gov source reviewed August 4, 2026: Protect Your Money: How to Avoid Investment Scams.
Inspect the workflow