Perceptron

Perceptron Mk1.5 is Perceptron's embodied reasoning model for physical agents. It accepts text, image, video, and audio input, and answers with text plus optional structured annotations: points, boxes, polygons, tracks, and clips. It supports graded reasoning through the standard reasoning controls, function tool calling, and structured outputs via JSON Schema. Structured annotations are emitted inline with text only when requested via the annotation_format parameter ("point", "box", or "polygon" for spatial localization on images, "clip" for temporal segments in video). Video soundtracks are analyzed only when enabled per request via provider.options.perceptron.enable_audio_in_video: true.

Perceptron Mk1 (Mark One) is Perceptron's highest-quality vision-language model for video and embodied reasoning.** It accepts image and video inputs paired with natural language queries, and produces detailed visual understanding responses, either structured or natural language. It excels at video understanding tasks like video QA, summarization, and event detection. On image inputs, it advances point-by-example grounding from multimodal prompts, OCR and document parsing on messy real-world inputs, open vocabulary object detection and counting, and hand pose estimation. Reasoning can be enabled per request to trade latency for deeper analysis on harder tasks. Structured annotations are emitted inline with text only when explicitly requested via the annotation_format parameter (pass "point", "box", or "polygon" for spatial localization on images, or "clip" (start/end timestamps) for temporal segments in video). Without annotation_format, the model returns natural-language text only.