TrackOSC
软件开发工具
- 创作者
- Joel Lewis
TrackOSC可将iPhone变成无线运动跟踪相机,对准人物就能在本地网络以OSC消息形式传输身体姿势、手部姿势、面部特征点、识别文本及动物等实时跟踪数据,供多种软件使用。所有处理在设备上借助Apple的Vision框架完成,无视频流出,仅数据传输。具备实时跟踪叠加、探测器切换、前后摄像头可选、支持多种方向、网络接收器自动发现及隐藏视频模式等功能。
软件开发工具
TrackOSC可将iPhone变成无线运动跟踪相机,对准人物就能在本地网络以OSC消息形式传输身体姿势、手部姿势、面部特征点、识别文本及动物等实时跟踪数据,供多种软件使用。所有处理在设备上借助Apple的Vision框架完成,无视频流出,仅数据传输。具备实时跟踪叠加、探测器切换、前后摄像头可选、支持多种方向、网络接收器自动发现及隐藏视频模式等功能。
点击查看界面细节
TrackOSC turns your iPhone into a wireless motion-tracking camera. Point it at a person and it streams live tracking data – body poses in 2D and 3D, hand poses, face landmarks, recognised text, animals, people, barcodes, outlines, the horizon and rectangles – over your local network as OSC (Open Sound Control) messages, ready for TouchDesigner, Max/MSP, Processing, openFrameworks, Pure Data, SuperCollider, Unity, or anything else that speaks OSC.
All processing happens on-device with Apple's Vision framework. No video ever leaves your phone – only numbers.
WHAT IT TRACKS
• 2D Body: a 17-joint skeleton in pixels
• 3D Body: a 17-joint skeleton in metres – real depth from a single camera, with each joint's pixel position alongside
• Hand: 21 joints per hand, up to two hands
• Face: the face box, head rotation and jawline contour, and Face Landmarks: the full 76-point constellation – eyes, pupils, brows, nose, lips, jaw
• Text: recognised text with its bounding box
• Animal: cat and dog boxes, and Animal Pose: full 25-joint cat and dog skeletons
• Human: whole-body boxes that keep counting people at distances where pose estimation gives up
• Barcode: QR codes and 1D/2D barcodes with position, corners, symbology and payload
• Contours: every edge outline in the frame as closed polylines
• Horizon: the horizon's angle and a line across the frame
• Rectangles: screens, paper, doors – a box plus four corners
FEATURES
• Live tracking overlays on the camera view, colour-coded per detector
• One chip per detector – run just what you need for the best frame rate; 3D Body runs in its own lane so it never slows the others
• Front or back camera, with a natural selfie mirror (wire data is never mirrored)
• Portrait and landscape, with an orientation lock for phones mounted on tripods and rigs
• Automatic discovery of receivers on your network via Bonjour – or type any IP and port
• Hide-video mode: tracking overlay only, on black – for stage and installation use
• Free, notari…
Three new things to track, a clearer face, and a new chip for landmarks.
• Face Landmarks: a chip of its own next to Face. Face sends the box with head angles and the jawline; Face Landmarks sends the full 76-point constellation – eyes, pupils, brows, nose, lips, jaw – now drawn feature by feature on the overlay.
• Contours: every edge outline in the frame, simplified and streamed as closed polylines.
• Horizon: the angle of the horizon and a line across the frame.
• Rectangles: screens, sheets of paper, doors – box plus four corners in the rectangle's own orientation.
• Twelve detector chips, in a row that scrolls sideways.
The new data goes out as three additional OSC messages (/contours/arr, /horizon, /rectangles/arr); every earlier message is unchanged, so existing receivers keep working. The free macOS apps – Receiver, Recorder, Speaker and Router – gain a true full-screen mode with a chosen background colour, and a Senders setting so a recording played back is never mixed with a live phone.
Everything is still processed on the device; no video ever leaves your phone.
还没有公开评论,欢迎分享你的体验。
TrackOSC
让使用你作品的人,认识背后的你。编辑确认身份后,将为你授予入驻开发者标识。
编辑将人工核实你的资料,如需补充信息会通过所填邮箱联系你。身份确认后,由编辑为你授予入驻标识。