A guiding theory for a continuous and cohesive discussion regarding generative artificial intelligence (GenAI) in science communication is still unavailable. Here, we propose a framework for characterizing, evaluating, and comparing AI-based information technologies in the context of critical engagement with scientific information in online environments. Hierarchically constructed, the framework observes technological properties, user experience, content presentation, and the context in which the technology is being used. Understandable and applicable for non-experts in AI systems, the framework affords a holistic yet practical assessment of various AI-based information technologies, providing both a reflection aid and a conceptual baseline for scholarly references.