LiDAR and RealityKit – Capture a Real World Texture for a Scanned Model

Object Reconstruction 10 October 2023, Apple released iOS Reality Composer 1.6 app that is capable of capturing a real world model’s mesh with texture in realtime using the LiDAR scanning process. But at the moment there’s still no native programmatic API for that (but we are all looking forward to it). Also, there’s a methodology … Read more

ARKit SKVideoNode Playing on Render

Ok. So here is a fix. see renderer(_:updateAtTime:). var player: AVPlayer! var play = true @objc func tap(_ recognizer: UITapGestureRecognizer){ if play{ play = false player.pause() }else{ play = true player.play() } } func setVideo() -> SKScene{ let size = CGSize(width: 500, height: 500) let skScene = SKScene(size: size) let videoURL = Bundle.main.url(forResource: “video.mp4”, withExtension: … Read more

How to create realistic .scn files?

To get some existing models to work with, here is what I did…just the basics that I know. I went to Turbosquid and found a 3D model that would work for me. Make sure it has the OBJ files. Buy and download. Next download Blender. Import the OBJ file you just bought. Export a DAE … Read more

ARKit – Get current position of ARCamera in a scene

Set yourself as the ARSession.delegate. Than you can implement session(_:didUpdate:) which will give you an ARFrame for every frame processed in your session. The frame has an camera property that holds information on the cameras transform, rotation and position. func session(_ session: ARSession, didUpdate frame: ARFrame) { // Do something with the new transform let … Read more

What’s the difference between using ARAnchor to insert a node and directly insert a node?

Update: As of iOS 11.3 (aka “ARKit 1.5”), there is a difference between adding an ARAnchor to the session (and then associating SceneKit content with it through ARSCNViewDelegate callbacks) and just placing content in SceneKit space. When you add an anchor to the session, you’re telling ARKit that a certain point in world space is … Read more

Unable to activate constraint with anchors

dan is right, you need to add sceneView as a subview before you can anchor it. Try something like this: view.addSubview(sceneView) sceneView.anchor(top: self.view.topAnchor, left: self.view.leftAnchor, bottom: self.view.bottomAnchor, right: self.view.rightAnchor, paddingTop: 0, paddingLeft: 0, paddingBottom: 0, paddingRight: 0, width: 0, height: 0)

RealityKit vs SceneKit vs Metal – High-Quality Rendering

Updated: March 11, 2023. TL;DR This post is not only about RealityKit, SceneKit & Metal, but also about related APIs and USD files. RealityKit 2.0 RealityKit is the youngest SDK in Apple family of rendering technologies. This high-level framework was released in 2019. RealityKit is made for AR / VR projects, has simplified settings for … Read more

ARKit vs. ARCore vs. Vuforia vs. D’Fusion Mobile vs. Layar SDK [closed]

I’ve used both D’Fusion and Vuforia and here are my feedbacks D’Fusion (Total Immersion) D’Fusion solution is a cross-platform tool which mainly supports Web, iPhone, Android plateforms. Main features are the followings: It is more UI based (D’Fusion Studio & D’Fusion CV) and enable to build the whole scenario through the GUI Scenario intelligence is … Read more