The Dark Side of AI-Powered Calorie Counting

The Promise of Convenience

Imagine snapping a photo of your meal, and an artificial intelligence system instantly tells you exactly how many calories you’re consuming. No more tedious manual logging, no more guessing at portion sizes, no more human error. Apps like Cal AI, Lose It!, and MyFitnessPal’s new photo features claim to revolutionize calorie tracking by letting your smartphone’s camera do the heavy lifting.

The Reality of Human Error

But as someone with a long, complicated history with calorie counting—and admittedly, a somewhat cursed expertise in it—I can tell you that counting calories with a photo is exactly as stupid as it sounds. The biggest problem with calorie tracking is indeed human error, but AI methods can’t solve it as easily as promised.

How AI-Powered Calorie Counting is Supposed to Work

Apps like Cal AI or SnapCalorie AI use visual cues like color, texture, and relative size to make educated guesses about what you’re eating and how much of it there is. They claim that AI methods can solve the pesky problem of human accuracy in calorie estimation—which, to be fair, is easy to get wrong.

The Setup Process

The setup process is straightforward: Download the app, create an account, input basic demographic information, and set your goals. However, the app’s initial messaging raises a red flag. The app cheerfully informs you that “losing 10 lbs is a realistic target”—except that losing 10 pounds would actually push you into underweight BMI territory.

Cal AI’s Photo Logging Process

Cal AI’s photo logging process follows these steps:

Take a clear photo of your food, ideally against a plain background.
Make sure all ingredients are visible and well-lit.
Include a reference object (like a coin or your hand) for scale.
Upload the image and wait for AI analysis.
Review and correct the app’s identifications and portion estimates.
Save the entry to your daily log.

The Reality of AI-Powered Calorie Counting

I started my testing with something simple: a Pink Lady apple weighing 222 grams. Surely this would be an easy win for the AI—apples are among the most photographed foods on earth, with a distinctive shape and color that should be instantly recognizable.

Cal AI confidently identified my apple as tikka masala. I gave it another chance, this time photographing the apple alongside its barcode and sitting on a kitchen scale displaying its exact weight. The app did recognize it as an apple this time, but estimated it at 80 calories when the actual count should have been closer to 120.

The real test came with a more complex meal: my current meal-prepped lunch of fried tofu, onions, cucumbers, tomatoes, feta cheese, and chickpeas, all generously dressed with an oil-based homemade vinaigrette. This is the kind of mixed dish that presumably showcases AI’s advantage over manual logging—no need to search for individual ingredients or estimate their quantities.

The Problems with AI-Powered Calorie Counting

The app identified the golden-brown fried tofu as croutons, which I had to manually correct. It did a reasonably good job recognizing the vegetables and feta, but completely whiffed on the oil content. Despite the salad being visibly glistening with dressing, the app estimated the entire dish at 450 calories.

This estimate was laughably low. A single can of chickpeas contains about 400 calories, and my portion included roughly that amount plus significant quantities of feta cheese and several tablespoons of olive-oil-based dressing. A realistic calorie count for this meal would have been closer to 800 to 900 calories.

The App’s Portion Estimation

The app’s portion estimation proved even more problematic than its ingredient identification. When I photographed a smaller serving—less than a quarter of the original salad—Cal AI estimated it at 250 calories. According to the app’s own logic, less than 25% of the meal somehow contained more than 55% of its calories.

Other Popular Apps

Other apps, like SnapCalorie and Calorie Mama, also claim to revolutionize calorie tracking. But my experience with these apps reveals similar problems with accuracy and reliability.

SnapCalorie: A Better Option

SnapCalorie did immediately assuage some skepticism by suggesting a much more reasonable daily calorie target of 1,900 calories, compared to Cal AI’s problematic weight loss messaging.

However, this accuracy comes at a steep price—$79.99 per year after just a one-week free trial, making it the most expensive option I tested.

Calorie Mama: A Disappointing Experience

Calorie Mama provided the most frustrating and laughable experience of the three apps. The interface feels rudimentary, and the app essentially abandons the premise of automated photo analysis.