LIGHTING INTERACTIVE / WEEKLY JOURNAL

Naura / 0356798 / Interactive Spatial Design
GCD60904 / Interactive Design
Weekly Journal

__________________________________________________________

Week 1

This week marked the introduction to our course, where we met Sir Shakir. He is part of a collective called Filamen, which specializes in lighting and immersive experiences across Malaysia. One of their most notable works is Immersio, an immersive projection-based installation.

Projection Mapping Basics

Projection mapping is a non-destructive technique, meaning it does not physically alter the surface onto which visuals are projected. This technique is broadly categorized into two types:

  • Outdoor Projection Mapping – Used to map visuals onto physical structures, such as buildings or sculptures.
  • Indoor Immersive Projection – Aimed at transporting the audience into another space using projected visuals, often in enclosed environments like galleries or exhibitions.
Key Considerations for Projection Mapping

For a projection mapping project to be effective, several factors need to be taken into account:

  • Narrative – The project should have a clear and engaging story.
  • Understanding the Canvas – The projection surface (e.g., building, sculpture) influences the design and mapping process.
  • Scale & Motion – Large-scale projections should use slower motion to prevent discomfort, such as nausea.
  • Creativity & Imagination – Projection mapping allows for limitless artistic expression.
  • Deformation – Warping images to fit the contours of the projection surface.
  • Light & Shadows – Utilized to create depth and illusion, enhancing the immersive effect.
Applications of Projection Mapping

Projection mapping is widely used in various fields, including:

  • Art Exhibitions – Enhancing traditional gallery experiences.
  • Immersive Performances – Integrating projections with live performances.
  • Immersive Experience Exhibitions – Creating large-scale interactive installations.
  • Immersive Learning Experiences – Using projection mapping for educational purposes.
Filamen Gallery Project

Our course project involves creating a one-minute immersive visualization, which will be exhibited at Filamen Gallery. The theme for this project is “Pulse/Nadi”, encouraging us to explore dynamic visual storytelling that resonates with the theme of rhythm, movement, and energy.

Tools & Software

Different software will be used at various stages of the project:

  • Storyboarding & Styleframes: Adobe Photoshop, Adobe Illustrator
  • 2D & 3D Animation: Adobe After Effects, Cinema 4D
  • Final Compositing: Adobe Premiere Pro, Final Cut Pro, Adobe Audition
Projection Setup

Projection setups vary depending on the complexity of the installation:

  • Single Projection – Uses one HDMI connection to display visuals.
  • Multi-Projection – Connects multiple projectors to a single source for a more expansive and immersive experience.

__________________________________________________________

Week 2

This week's lecture served as a recap of both last week’s session and our site visit to Muzium Telekom. The visit provided valuable insights, which were further discussed during the lecture. One key observation was the delay in animation transitions during the experience. This was attributed to voids in the projection template, which cause a slower transition between surfaces, such as from the floor to the wall.

Another significant takeaway was how visitors engaged with the projections. It was noted that people preferred projections on the walls rather than the floors, likely due to spatial dimensions and comfort. Looking down at the floor for extended periods may strain the neck, whereas wall projections align more naturally with eye level, providing a more comfortable viewing experience.

During the lecture, we also gained insights into Mr. Shakir’s approach to maintaining style consistency in his projects. His team uses mood boards or assigns a single artist to ensure cohesiveness. If resources allow, they outsource asset creation while the in-house team focuses on animation.

Mr. Shakir also introduced us to the lens shift feature found in larger projectors, which allows precise adjustments without manually repositioning the projector (which he used for the projection mapping done in Penang). This knowledge is crucial for refining projection mapping techniques.

Fig 2.1 - MBPP Projector Calculations

Additionally, Mr. Shakir shared examples of university student projects created for competitions and events. This helped us understand the importance of storyboarding, which typically consists of six main frames with sketches and brief descriptions. He also emphasized the role of animatics in combining these frames with sound to preview animation timing and transitions, ensuring a well-structured narrative flow.

__________________________________________________________

Week 3

Today, Mr. Shakir introduced us to Pulse of Nature by Henry Hu, an installation in San Francisco. Through this example, we explored how sound enhances storytelling and emotional depth in animation. The discussion emphasized the importance of integrating audio to create more immersive and impactful animations.

12 Principles of Animation

Fig 3.1 - Principles of Animation


Mr. Shakir also discussed the 12 Principles of Animation, using a YouTube video by Emanuele to illustrate key techniques for making animations feel natural and believable:
  1. Squash and Stretch – Adds weight and volume to characters or objects.
  2. Anticipation – Prepares the audience for larger actions with small preceding movements.
  3. Follow Through & Overlapping Action – Ensures movements continue naturally after the main action.
  4. Arcs – Objects and characters move in natural, curved paths.
  5. Slow In & Slow Out – Gradual acceleration and deceleration for realism.
  6. Timing – Adjusts speed and mood through frame count.
  7. Secondary Action – Enhances primary movements by adding depth.
  8. Straight Ahead vs. Pose to Pose – Two animation approaches: frame-by-frame vs. keyframe planning.
  9. Staging – Directs focus using composition techniques like the rule of thirds.
  10. Exaggeration – Amplifies movements or expressions for dramatic effect.
  11. Solid Drawing – Maintains proportions and perspective for believable motion.
  12. Appeal – Creates engaging and emotionally compelling designs.
We also explored Motion Graphics, its evolution, and its role in digital media. Initially created frame by frame in black and white, motion graphics now utilize vibrant colors and advanced software.

Applications of Motion Graphics
  • Social media content
  • Digital posters and advertisements
  • Film and animation enhancements
  • Projection mapping for immersive experiences
  • Exhibitions and installations
  • Interactive applications
Common Motion Graphics Software
  • Adobe After Effects – Industry-standard for animation and compositing
  • Nuke – Node-based visual effects compositing
  • Rive – Quick preset animations with some limitations
  • Fable – Web-based motion design tool
  • Canva – Simplified motion graphics for beginners
  • Calvary – Data-driven animation tool
  • Figma – UI/UX design with motion capabilities
  • Blender – Open-source 3D animation suite
  • Cinema 4D – Advanced 3D modeling and animation software
The principles and tools covered today will be essential for Assignment 3, where we will bring our story and concept to life through animation. 

__________________________________________________________

Week 4

Since Mr. Shakir was absent, today’s lecture was conducted by Mr. Zeon, who provided a theoretical session to assist with Assignment 2. The focus was on developing a narrative concept or script for projection mapping. A strong narrative outline is essential for structuring our storytelling process, maintaining logical flow, and ensuring emotional engagement.

Key Elements of a Narrative Outline:
  • Project Title – Defines the identity of the project.
  • Project Objective – Establishes the purpose and goals.
  • Target Audience – Identifies the intended viewers.
  • Theme – PULSE/NADI (Rhythm, Connection, Life).
  • Characters & Setting – Determines the visual and spatial environment.
  • Key Events & Scenes – Maps out the transition from chaos to harmony through movement and light.
  • Emotional Journey – Highlights the shifts between tension and resolution, structured as:
    1. Background – Establishes context.
    2. Conflict & Rising Action – Introduces disorder and disconnection.
    3. Climax – The moment of synchronization.
    4. Falling Action & Resolution – The emergence of balance and unity.

Fig 4.1 - Plot/ Emotional Journey

Projection Mapping: Indoor vs. Outdoor

Since our project will be showcased at Muzium Telekom, an indoor setting, it provides key advantages over outdoor setups:

  • Consistent Lighting – Controlled light sources enhance visual clarity.
  • Easier Hardware Setup – Projectors and sensors can be securely installed for efficiency.
  • Stronger Audience Engagement – Enclosed spaces enhance immersion and emotional impact.

These benefits make indoor projection optimal for expressing the PULSE/NADI theme with precision and clarity.

Storyboarding & Moodboard for Visual Development

To translate the narrative into visuals, we utilize two essential tools:

Storyboard

A storyboard visually maps out the projection sequence, transforming script elements into structured imagery. It helps to:

  • Identify gaps or weaknesses in storytelling.
  • Plan camera angles, movements, and special effects.
  • Ensure a cohesive flow from scene to scene.
Fig 4.2 - Storyboard Example

Moodboard

A moodboard helps define the aesthetic and emotional direction before production begins. It ensures consistency by incorporating:

  • Images – Visual references for inspiration.
  • Color Palettes – Establishes tone and mood.
  • Textures & Patterns – Adds depth to the design.
  • Typography – Enhances visual communication.
  • Dynamic Elements – Influences animation style.
Fig 4.3 - Moodboard Example

Applications of Projection Mapping

Projection mapping has diverse uses, reinforcing its relevance in creative industries:

  • Advertising & Marketing – Captures audience attention through dynamic visuals.
  • Events & Entertainment – Used in concerts, festivals, and corporate events.
  • Storytelling & Exhibitions – Enhances narratives through interactive projections.
This lecture provided essential knowledge for Assignment 2, where we will be documenting the storytelling process in our projection mapping project. 

__________________________________________________________

Week 5

During the lecture, I learn that technically we can outsource other assets, but the primary aim of this project is to create immersive projection. To achieve this, we utilize various software tools depending on the type of content being created. For graphic and vector work, we use Adobe Illustrator. For illustrations, we rely on Adobe Illustrator and Photoshop. When working with generative design, we use Processing and Touch Designer. 

When importing Photoshop files into After Effects, the process involves dragging the Photoshop file into the Project Panel. There are multiple import options: Footage (single-layer import), Composition (which may require scale adjustments), and Precomposition (useful for grouping elements together for easier adjustments). 

In After Effects, we use various transform properties to manipulate objects. The most common shortcuts include: 
  • S for Scale
  • P for Position
  • R for Rotation
  • T for Opacity. 
And understanding these shortcuts enhances workflow efficiency. 

For masking, we start by selecting the Shape Tool and choosing a desired shape. Once selected, the shape is applied to the layer inside the canvas, allowing for controlled masking effects. 

The Effects and Presets Panel, found on the right side, enables users to pick and drag effects onto layers. Once an effect is applied, its properties can be customized using the left panel. 

Some commonly used effects in After Effects include:
  • CC Kaleida: creates repetitive patterns
  • CC Repetile: expands video content. 
For chroma keying, we use Keylight/Linear Color Key to extract green screen elements. Additionally, for VR content, the Immersive Video effect is used to enhance virtual reality projections.

__________________________________________________________

Week 6

This week, we continued learning more techniques in Adobe After Effects, the tutorials and effects taught by Mr. Shakir have been especially useful, providing more options for us to improve animation quality and transition effects.

Additionally, Mr. Shakir mentioned that he will share a digital mockup file, allowing us to visualize how our content will look when projected. This will help us evaluate the smoothness of transitions, especially between different surfaces like walls and floors, which is a key concern in maintaining seamless projection mapping.

Key Techniques in Adobe After Effects

1. Alpha Matte (Layer Masking)
  • In the Layers Panel, drag the curly icon to another layer to create an alpha matte.
  • Useful for masking effects and creating smooth transparency-based transitions.
2. Eye Transition Effect
  • Create an oval shape.
  • Adjust the Anchor Point to ensure smooth scaling.
  • Apply a Mask to create a seamless transition effect.
3. Blurry Effect
  • Apply Gaussian Blur from the Effects Panel (Right-Side Panel).
  • Adjust intensity for depth and focus effects in animations.
4. Rotoscoping (Extracting Objects from Video)
  • Use the Roto Brush tool to separate objects from their backgrounds in videos.
  • Essential for layering real-world footage with animation.
5. Puppet Tool (Character Animation)
  • Select the Puppet Pin Tool from the toolbar.
  • Click on an object to create joints.
  • Move joints to animate and create organic motion.
6. Keyframe Navigation & Layer Control
  • Press “U” to show all keyframes on a layer.
  • Parenting & Linking: Drag the curly icon to the parent layer (e.g., linking a leg to a body for cohesive movement).
7. Wiggle Expression (Randomized Motion)
  • Select a layer, then Alt + Click on the stopwatch beside the property (e.g., Position, Rotation).
  • Enter: wiggle(x, y)
    • Example: wiggle(2, 5) adds subtle movement (x = frequency, y = intensity).
8. Plugins & Extensions
  • Compatible with:
    • Motion Array – Prebuilt templates and animations.
    • AE Scripts – Additional tools to speed up workflows.
9. Rendering & Exporting
  • Go to CompositionAdd to Render Queue.
  • Set Best Settings and choose H.264 for general export.
  • For a transparent background, select QuickTime with Alpha Channel enabled.
10. Digital Mockup & Projection Preview
  • Click the icon beside “Quarter” to preview in 3D mode.
  • The digital mockup file (to be shared by Mr. Shakir) will allow us to:
    • Check how visuals interact with different surfaces.
    • Ensure smooth transitions between walls and floors.
With these tools and insights, we can better plan and refine our animation workflow, ensuring a polished final projection.

__________________________________________________________

Week 7

This week marked our final tutorial and consultation before submission. While we were introduced to Resolume Arena, we were informed that we don’t need to use it for our final assignment due to time constraints. Instead, our focus remained on refining our Adobe After Effects animations and ensuring our projection mapping content is polished.

Collecting Files for Export (Avoiding Missing Files)
  • Mr. Shakir emphasized that when exporting and sharing Adobe After Effects files, missing assets can cause issues.
  • To prevent this, we should "Collect Files" in After Effects.
  • This gathers all linked assets into one folder, ensuring nothing is missing when moving files to different locations.
  • This will be extremely useful during site setup, reducing last-minute stress.

Although we won’t be required to use Resolume Arena, we explored its basic functions for projection mapping workflow.

Setting Up Projection in Resolume Arena
  • Import the Template – Load the desired template into Resolume.
  • Adjust Composition Settings – Set the resolution to match the image dimensions.
  • Arrange Inputs – Organize and align visuals in the Screen section.
  • Resize for the Mockup – Go to Slice > Crop & Transform to adjust proportions.
  • View in 3D Mockup – Click Output Transformation to preview projection alignment.
Connecting to a Projector
  • Physical Connection – Use an HDMI, VGA, or DisplayPort cable.
  • Display Settings – Adjust your computer’s settings to extend or duplicate the screen.
  • Projector Settings – Select the correct input source on the projector.
Resolume Arena: Input vs. Output
  • Input – The visual content being mapped.
  • Output – The final projection onto a surface.
  • Sections of an image/video can be mapped individually to align with the projection surface.

Comments

Popular Posts