# Construction as Alchemy

{% hint style="danger" %}
This page is currently a work in progress.

We are updating this resource so please check back soon!

NExT Lab Team.
{% endhint %}

## Presentation

The Construction as Alchemy Introduction Slides are hosted on Github and available here:

{% embed url="<https://msd-next.github.io/introductory_sessions/presentations/AugmentedRealitySubjectEngagement.html>" %}

## HoloLens

The Microsoft HoloLens is an **inside-out** tracking headset which uses spatial mapping to map out surfaces as a **mesh**.

![Figure 1.0 - Mesh Construction](https://1820679795-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-LXautSvCbUco5Lv7YrH%2F-LbMfHQPNXY17E_Gtwav%2F-LbMfLgbVOfUEFv7d79w%2FmeshTracking.gif?alt=media\&token=753bd1d2-6c8e-448a-ba21-1f951abb6ee4)

MSD has ten HoloLens units which can be booked out from the [Loans Desk](https://msdunimelb.simplybook.me/v2/#book/location/1/category/46/) or the [NExT LAB](https://msdunimelb.simplybook.me/v2/?widget-type=button\&theme=hugo\&theme=hugo\&timeline=modern\&datepicker=top_calendar#book/location/2/category/23/service/174/).

The starter Hololens guide can be found here; familiarise yourself with the handling of the headset and the gestures used to interact with the system.

{% content-ref url="../../platforms-hardware/microsoft-hololens" %}
[microsoft-hololens](https://ms-kb.msd.unimelb.edu.au/next-lab/augmented-reality/resources/platforms-hardware/microsoft-hololens)
{% endcontent-ref %}

## Fologram

![Figure 2.0 - Fologram](https://1820679795-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-LXautSvCbUco5Lv7YrH%2F-LbMfHQPNXY17E_Gtwav%2F-LbMfYVwy7au8SvbE0wb%2Ffologram.jpg?alt=media\&token=24dc0aba-66af-4411-9dba-aefaabbb7b39)

**Fologram** is a tool which integrates the **HoloLens** with **Rhino3d**. It allows a user to virtually project the geometry within Rhino into a physical environment.&#x20;

**Fologram for Rhino** is available for Download [here](https://fologram.com/download). Please download and install the latest version.

### Connect your HoloLens

1. Ensure devices are on the same network, this will usually be UniWireless.
2. Open your file in Rhino
3. On the **HoloLens**, `bloom` and **run** `Fologram`
4. In Rhino, **run** `Fologram` in the command line and **click** `Connect a Device`
5. A QR Code should pop up on screen.
6. Back in the Hololens, look at the screen with Rhino to **Scan** the QR Code
7. **Tap** to place your geometry for now.

### Model Placement with QR Codes

**QR codes** are available for download [here](https://fologram.com/docs/articles/900000187603). You will be required to download and use the provided Construction as Alchemy Casa QR Templates available for download below in both PDF and Rhino format.

{% file src="<https://1820679795-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-LXautSvCbUco5Lv7YrH%2F-M2C-o6LmRFir0ZC53Nc%2F-M2CCWGbV2PUuvK-BUux%2FQRCodeCASATemplate.pdf?alt=media&token=583cba39-5d3e-45fd-9d34-525b0d7e6fe3>" %}
QR Code Casa Template PDF
{% endfile %}

{% file src="<https://1820679795-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-LXautSvCbUco5Lv7YrH%2F-M2WQhVCt6LdLTIbMHlv%2F-M2WpC3XGI-NNydMK51B%2FFologram%20QR%20CASA%20Template.zip?alt=media&token=c1bb3d5a-78fc-40a0-9207-4f83110278e3>" %}
Fologram Casa Template
{% endfile %}

QR codes are a representation of the Rhino **Construction Plane** and allows users to project their geometry accurately and consistently into the physical environment with reference to the **Rhino origin point**.

![Figure 2.1 - QR code placed on corner of CASA Template](https://1820679795-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-LXautSvCbUco5Lv7YrH%2F-M2By8K7IXymXY3JxAaT%2F-M2ByxKZHEVy7FbWY96E%2F1D1A0258_EDIT2.jpg?alt=media\&token=cfe63f4b-e2cc-431b-849b-6bc923d7554c)

Follow [these](https://fologram.com/docs/articles/900000187603) instructions for Generating QR codes, placing your model and making adjustments / re-placing.

![Figure 2.2 - QR code example](https://1820679795-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-LXautSvCbUco5Lv7YrH%2F-M2By8K7IXymXY3JxAaT%2F-M2C-9berdkCuUNTTxeK%2FQR%20Code.JPG?alt=media\&token=abf1b173-612e-42d2-aef6-5ee4fe3b94f6)

### View and modify Rhino model in real time

#### Scale

Fologram allows you to preview and modify materials, scale and position of your Rhino model in real time in mixed reality.

#### Layers

Fologram allows you to preview and modify Rhino Layers in real time in mixed reality. This can be a good way of rapidly moving between different layers in your file, and turning different brick courses on or off.

#### Grasshopper Parameters

### Mixed Reality Capture

Follow [these](https://fologram.com/docs/articles/900000191083#4-ways-to-stream,-film-and-share-your-mixed-reality-experiences) instructions for how mixed reality experiences can be documented and shared through;

1. Recording video from Fologram for Mobile
2. Recording your screen on Mobile
3. Recording and Streaming Mixed Reality capture from the HoloLens using Device Portal
4. Streaming using Miracast

**Click** the `IP Address` to open **Mixed Reality Capture**.&#x20;

**Username:** `msdhololens`\
**Password:** `msdhololens`

### View and modify Rhino model in real time

#### Scale

Fologram allows you to preview and modify materials, scale and position of your Rhino model in real time in mixed reality.

#### Layers

Fologram allows you to preview and modify Rhino Layers in real time in mixed reality. This can be a good way of rapidly moving between different layers in your file, and turning different brick courses on or off.

#### Grasshopper Parameters

### Share the experience

Fologram allows you to share your mixed reality experiences by placing shared models in the same location. Follow [these](https://fologram.com/docs/articles/900000187803#Presenting-your-mixed-reality-experience-on-multiple-Hololens-and-mobile-phones) instructions for how to connect multiple devices.

### Save models to device for offline access

### Mixed Reality Capture

## Preparing your Rhino File

Follow [these](https://fologram.com/docs/articles/900000191083#4-ways-to-stream,-film-and-share-your-mixed-reality-experiences) instructions for how mixed reality experiences can be documented and shared through;

1. Recording video from Fologram for Mobile
2. Recording your screen on Mobile
3. Recording and Streaming Mixed Reality capture from the HoloLens using Device Portal
4. Streaming using Miracast

**Click** the `IP Address` to open **Mixed Reality Capture**.&#x20;

**Username:** `msdhololens`\
**Password:** `msdhololens`

### Share the experience

Fologram allows you to share your mixed reality experiences by placing shared models in the same location. Follow [these](https://fologram.com/docs/articles/900000187803#Presenting-your-mixed-reality-experience-on-multiple-Hololens-and-mobile-phones) instructions for how to connect multiple devices.

![Arrange breps in to layers based on their height.](https://1820679795-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-LXautSvCbUco5Lv7YrH%2F-LbMdNLp98Wa0xMKb9IS%2F-LbMf6qs02jwUMEpJhPK%2FfologramBricksRhino.PNG?alt=media\&token=1292e2ef-deec-44e6-8aea-a4f3b19e1f38)

Fologram will display anything in the viewport.&#x20;

1. Arrange your brick wall in to **layers** based on their **Z-Height**.&#x20;
2. Use layer visibility, or the `hide` command, to control the visibility of objects in Rhino.
3. If you are using the **NExT Lab CASA template**, move your geometry **+500 mm** along the x-axis.

{% file src="<https://1820679795-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-LXautSvCbUco5Lv7YrH%2F-M2WwbNHi7hNhvD9R6ri%2F-M2X-6VzM9loTT5WN9wg%2FFologram%20QR%20CASA%20Template_ExampleWall.zip?alt=media&token=cb37f6e9-1bd4-45f9-ab57-f45214a994e8>" %}
Download Example file here
{% endfile %}

## Fabricating your Wall

* You can collect a template from the NExT Lab.&#x20;
* Next Lab Sessions run from **1pm to 4pm**
* If there are no NExT Lab sessions available, you can loan a **HoloLens** out from the **Loans Desk**.
* There might not always be space in the NExT Lab
* The NExT Lab staff are **not teaching staff** and will not always be able to help. We will try our best.

1. [Connect your Hololens ](#2-1-connect-your-hololens)
2. [Use the Image Tracker.](https://learn.fologram.com/hc/en-us/articles/360002582894-Using-the-image-tracker-to-register-Holograms-to-physical-spaces) On the **HoloLens**, `click and hold` then **select** `Adjust > Image Tracker`
3. In Rhino, show/hide layers as required.&#x20;

## Using Grasshopper

{% hint style="danger" %}
Please **ONLY** use this template if you are familiar with Grasshopper
{% endhint %}

A simple grasshopper definition which categorises geometry into layers based on their Z-Height has been made available. Only use this definition if you are comfortable working in Grasshopper.

Download the example file here:

{% file src="<https://1820679795-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-LXautSvCbUco5Lv7YrH%2F-LbPqavqgdY051Rwe5GN%2F-LbPqt3cRSxO-u1ruFOI%2F01042019_CASA_BrickStacking.gh?alt=media&token=1046f4cd-2380-42af-b106-92803a796f94>" %}
Construction as Alchemy Brick Stacking Fologram Example (GRASSHOPPER)
{% endfile %}
