TrackOSC

TrackOSC

Software development tools

Creator
Joel Lewis

TrackOSC can turn an iPhone into a wireless motion tracking camera. Point it at a person and it can transmit real-time tracking data such as body poses, hand poses, facial feature points, recognized text, and animals in the form of OSC messages over the local network for use by various software. All processing is done on the device with the help of Apple's Vision framework, with no video streaming out, only data transmission. It has features such as real-time tracking overlay, detector switching, optional front and rear cameras, support for multiple orientations, automatic discovery of network receivers, and a hidden video mode.

COMMUNITY PERKSMergeek 社区专属福利
独家限免 NEW每天发现一份惊喜
PRODUCT SCREENS / 1

点击查看界面细节

TrackOSC 产品截图 1

TrackOSC turns your iPhone into a wireless motion-tracking camera. Point it at a person and it streams live tracking data — body poses, hand poses, face landmarks, recognized text, and animals — over your local network as OSC (Open Sound Control) messages, ready for TouchDesigner, Max/MSP, Processing, openFrameworks, Unity, or anything else that speaks OSC.

All processing happens on-device with Apple's Vision framework. No video ever leaves your phone — only numbers.

FEATURES
• Live tracking overlays on the camera view: body skeleton, hand skeletons, face box, jawline contour and landmarks, text and animal boxes
• Per-detector toggles — run just what you need for the best frame rate
• Front or back camera, with a natural selfie mirror (wire data is never mirrored)
• Portrait and landscape, with an orientation lock for phones mounted on tripods and rigs
• Automatic discovery of receivers on your network via Bonjour — or type any IP and port
• Hide-video mode: tracking overlay only, on black — for stage and installation use
• A free, notarized macOS receiver and a hackable open-source Processing sketch are available from the project page

COMPATIBILITY
TrackOSC speaks exactly the same OSC wire format as VisionOSC and PoseOSC, so existing receivers and patches work unchanged. Coordinates are in pixels, origin top-left, with the frame dimensions in every message.

PRIVACY
No accounts, no analytics, no ads. Camera frames are analyzed on the device and discarded; tracking data is sent only to the destination you choose.

TrackOSC is open source: https://github.com/JGL/TrackOSC

版本

1.6.0

Three new things to track, a clearer face, and a new chip for landmarks.

• Face Landmarks: a chip of its own next to Face. Face sends the box with head angles and the jawline; Face Landmarks sends the full 76-point constellation – eyes, pupils, brows, nose, lips, jaw – now drawn feature by feature on the overlay.
• Contours: every edge outline in the frame, simplified and streamed as closed polylines.
• Horizon: the angle of the horizon and a line across the frame.
• Rectangles: screens, sheets of paper, doors – box plus four corners in the rectangle's own orientation.
• Twelve detector chips, in a row that scrolls sideways.

The new data goes out as three additional OSC messages (/contours/arr, /horizon, /rectangles/arr); every earlier message is unchanged, so existing receivers keep working. The free macOS apps – Receiver, Recorder, Speaker and Router – gain a true full-screen mode with a chosen background colour, and a Senders setting so a recording played back is never mixed with a live phone.

Everything is still processed on the device; no video ever leaves your phone.

查看完整更新记录 ↗

你的真实体验,为其他用户提供宝贵参考,获得宝石奖励

REWARD MARKET100 宝石可兑换什么?

还没有公开评论,欢迎分享你的体验。

提交反馈

每一个想法,都让 Mergeek 更好一点。