NEO: PaletteⓇ
Palette-type interface for data movement in eXtended reality (2023)
Palette-type interface for data movement in eXtended reality (2023)
In the extended reality space where XR (eXtended Reality) has become commonplace, the movement of data will increase due to activities such as meetings, editing work, collaboration, and exhibitions.
NEO: PaletteⓇ is a palette that helps data movement in the XR environment. By making the direction of data movement intuitive, it expands the scope and method of utilizing data, and furthermore, helps to immerse yourself in the context of data and users.
NEO: PaletteⓇ is a palette that helps data movement in the XR environment. By making the direction of data movement intuitive, it expands the scope and method of utilizing data, and furthermore, helps to immerse yourself in the context of data and users.
Overview
As XR devices and related services become more commercialized, situations in which multiple users simultaneously move data will become more frequent, such as meetings, collaborations, and exhibitions. In this situation, the modal-based data movement method, such as the file selection window, is not only cumbersome due to its depth, but also causes users to repeatedly perform unnecessary actions to select files.
NEO: Palette is a UI component that helps move data in the XR environment. I got an interaction motif from a palette where I paint right where I want. By putting data in palette-type components, data such as text, images, videos, and files can be intuitively moved to the destination the user wants at once. This is effective in reducing the learning curve of XR users and increasing interest.
Through this, you can group data at various angles or emphasize important data with animation. If you get too immersed in your data, you might end up loving it or tearing it up and deleting it yourself. This means that the scope and method of using data will be expanded, helping users to effectively immerse themselves in the data itself as well as the work context.
Problems
When moving data through waypoints such as galleries and file attachment modals, the following pain points may occur in XR.
(1) Different data attachment methods: Different apps have different interfaces and methods for attaching data.
(2) Causing selection mistakes: Increased fatigue in the selection process through controller and gestures.
(3) Different moving directions: Check which data has been sent where.
When moving data through waypoints such as galleries and file attachment modals, the following pain points may occur in XR.
(1) Different data attachment methods: Different apps have different interfaces and methods for attaching data.
(2) Causing selection mistakes: Increased fatigue in the selection process through controller and gestures.
(3) Different moving directions: Check which data has been sent where.
Solution
Palletizing data : You can organize your data by type, just like you organize your paints by color in a palette.
Palette modularization : It's modularized, like a palette with two plates connected, so it can change shape based on context.
Palletizing data : You can organize your data by type, just like you organize your paints by color in a palette.
Palette modularization : It's modularized, like a palette with two plates connected, so it can change shape based on context.
Interface
(1) Data : Provides an intuitive sense of what kind of format-content it is.
(2) Palette : An area to hold data.
(3) Palette controller : Pinch to move the palette or switch modes.
(4) Palette interface : Shows the selected data contents, the name of the palette and whether you're involved, and who you belong to.
(1) Data : Provides an intuitive sense of what kind of format-content it is.
(2) Palette : An area to hold data.
(3) Palette controller : Pinch to move the palette or switch modes.
(4) Palette interface : Shows the selected data contents, the name of the palette and whether you're involved, and who you belong to.
Next evolution of palette, NEO: PaletteⓇ
Interaction Cinematics
This video is a collaborative scenario from a competition featuring key interactions with Neo: Palette's core interactions in a competition collaboration scenario.
This video is a collaborative scenario from a competition featuring key interactions with Neo: Palette's core interactions in a competition collaboration scenario.
⑴ Create a palette and add data to it
Create a palette next to the browser panel, and drag the competition reference images into the palette.
Create a palette next to the browser panel, and drag the competition reference images into the palette.
⑵ Move, expand the palette
Switch the palette from panel mode to solid mode, moving it forward and expanding it.
Switch the palette from panel mode to solid mode, moving it forward and expanding it.
⑶ Data connecting
After connecting similar reference images together, we head inside with our friends.
After connecting similar reference images together, we head inside with our friends.
⑷ Data Motion
Select the images you need while meeting with your friends. Give the selected image a dynamic motion to emphasize it.
Select the images you need while meeting with your friends. Give the selected image a dynamic motion to emphasize it.
⑸ Data Anger
Shredding out-of-date contest brief files, you get emotional about your data.
Shredding out-of-date contest brief files, you get emotional about your data.
⑹ Social Palette
Ask other friends to join you as you explore their different theme palettes.
Ask other friends to join you as you explore their different theme palettes.
Interaction
(1) Solid Mode :
- Suitable for vertical movement · Interactive data movement.
- Can be used by placing it in front of the required action panel or by moving it around.
Context-sensitive angle :
Provided at a 90° angle to provide a sense of security around the data, but can also be used at a 30° more tilted angle when NEAR or in context.
(1) Solid Mode :
- Suitable for vertical movement · Interactive data movement.
- Can be used by placing it in front of the required action panel or by moving it around.
Context-sensitive angle :
Provided at a 90° angle to provide a sense of security around the data, but can also be used at a 30° more tilted angle when NEAR or in context.
(2) Panel Mode :
Suitable for horizontal movement · focusing on the task panel.
It is easy to remember the position intuitively as it is fixed next to the work panel.
Placement in a large area :
Since the horizontal length is longer than the vertical, it can be placed in a larger area than the comfort zone.
Suitable for horizontal movement · focusing on the task panel.
It is easy to remember the position intuitively as it is fixed next to the work panel.
Placement in a large area :
Since the horizontal length is longer than the vertical, it can be placed in a larger area than the comfort zone.
Hand Gestures
Realistic Hands provide enhanced immersion and a sense of realistic interaction.
(1) Pinch : Select Data · Interface (pinch with thumb and forefinger touching)
(2) Pinch - : Move Data · palette (keep thumb and index finger together)
(3) Flip : Enter Menu · Select (flip hand horizontally while pinching)
(4) Shake : Auto-align data (pinch and quickly move left and right)
Realistic Hands provide enhanced immersion and a sense of realistic interaction.
(1) Pinch : Select Data · Interface (pinch with thumb and forefinger touching)
(2) Pinch - : Move Data · palette (keep thumb and index finger together)
(3) Flip : Enter Menu · Select (flip hand horizontally while pinching)
(4) Shake : Auto-align data (pinch and quickly move left and right)
(1) Small task
For personal work · small collaboration:
Panel type · three-dimensional type with short extension
Can be used alone or shortly expanded for good mobility
For personal work · small collaboration:
Panel type · three-dimensional type with short extension
Can be used alone or shortly expanded for good mobility
(2) Large task
For collaboration, exhibition, meeting, etc:
Extend to the X-axis in a three-dimensional shape and use it fixedly
Expands by 3x - 6x depending on whether the user is mobile or not
For collaboration, exhibition, meeting, etc:
Extend to the X-axis in a three-dimensional shape and use it fixedly
Expands by 3x - 6x depending on whether the user is mobile or not
(3) Side task
Used contextually in individual and collaborative situations :
Use by expanding to the Z-axis in a stereoscopic view
Unobtrusive for long periods of use
Used contextually in individual and collaborative situations :
Use by expanding to the Z-axis in a stereoscopic view
Unobtrusive for long periods of use
Change the palette into various shapes according to your XR work context.
NEO: PaletteⓇ moves data 'intuitively' to its destination. Therefore, the scope and method of utilizing data is expanding, which will be an inevitable change in data movement that will become common in the near future.