Execution on Smart Glasses

Modified on Tue, 12 Nov at 12:22 PM

Execution on Smart Glasses

Note: The Frontline Workplace app should be pre-installed and the user must be signed in. To install Frontline Workplace, see the Android Wearables section.

Note: Ensure that you have a template created for the signed-in user and the sample picking order is uploaded into the Picking Orders on Pick. To download the sample order check our Templates page under the Pick section.

Introduction

In this section, we will go through how a Frontline Worker can execute a task created from the Vision-Picking workflow. There are many use cases for Vision Picking such as; warehouse order picking, inventory management, returns processing, unloading and sorting. The primary goal is to make tasks hands-free, faster and more secure. In order to achieve this, the process is designed with voice commands w'th which the workflow is executed step by step. Main picking screen, picking workflow are explained below followed by with process exceptions.

Navigation

Using on-device controls

In addition to voice commands, you can also use any physical buttons or touchpads on your device to navigate through the Frontline Workplace app and perform certain actions. For more information, please have a look at the user manual for your specific device.

Using the voice commands

Voice commands are a very convenient way to interact with your device in a hands-free way. Depending on the current screen, there are different actions that can be triggered by simply saying a specific command.

Global voice commands

In addition to voice commands that are only available on certain screens to perform specific actions, Frontline Workplace also offers global voice commands that are available throughout the entire application.

Here’s a list of global commands:

Show commands: Shows all available voice commands for the current screen
Hide commands: Hides the list of available voice commands for the current screen
Flashlight on: Turns the flashlight on (if the device has one)
Flashlight off: Turns the flashlight off (if the device has one)
Report error: Allows you to send info to the Frontline admin to report an issue

Main picking screen voice commands

Bluetooth Settings: Allows the pairing of an external barcode scanner via Bluetooth
Call Support: Allows the Frontline Worker to the Frontline Expert via an xAssist call
Cancel Order: Cancels the current picking order
Cancel Pick: Cancels the current pick
Early Deposit: Cancels the rest of the order and moves to the deposit component
Go to History: Shows the picks that were completed within an order
Indirect Work: Keeps track of the side tasks while the picking is in progress
Open Exceptions: Display all the available exceptions
Pause Order: Pauses the current order for the time being
Pick Selector: Allows the user to move to the next pick step without following the picking sequence
Postpone: Allows to move the current pick to the end of the order
Short Pick: Allows the user to pick less items than needed
Start Scanner: Launces the built-in camera of the smart glass and allows the user to scan

Main picking screen UI

The following UI displays the main picking screen from steps 6-9 of executing the picking workflow.

A - Battery shows the current battery level and the charging state.

B - Wi-Fi connection shows the current Wi-Fi connection status of your device.

C - Server connection shows the current connection status of your device to the Frontline server.

D - Microphone shows the current status of your device's microphone.

E - External scanner status shows whether an external scanner is connected (in white) or not (in red).

F - xBand status shows whether an xBand is connected (in white) or not (in red).

G - Progress bar shows the name of the whole order.

H - Order name shows the name of the current order being executed.

I - Pick progress indicator shows the currently active validation (Colors can be configured using the focus accent color.).

J - Pick source location shows where the Frontline Worker picks the article from.

K - Article ID shows the item that the Frontline Worker is supposed to pick.

L - Amount shows the specific fractions or items that the Frontline Worker is required to pick. Additionally, there is an option to view countdowns for the remaining items. These features are determined by the chosen settings of the Vision Picking Workflow.

M - Article short text shows the article text instead of the article image if it is not uploaded.

Executing the picking workflow

Once the prerequisites for the Vision Picking workflow execution are done, follow the steps below:

1. Sign in to the Frontline Workplace app.

2. Select My Tasks.

3. Select a relevant task from the list of available tasks.

4. Connect the Bluetooth scanner.

To connect the Bluetooth scanner:

The user must select Search to look for an available scanner. Otherwise, the user selects Continue to skip the step and proceed without a scanner.

Note: To learn more about how to connect scanners to smart glasses see Scanners under the Pick section.

Note: If a device is previously connected, the scanner icon shows white.

Select Continue to proceed with the connected scanner, otherwise select Forget to disconnect and search for a new scanner.

5. To request the picking order the user must select one of the following options:

Next available order: Directs the user to the available picking task.
Scan using camera: Allows the user to scan a task order ID using the built-in camera.
Select from list: Allows the user to see all available order lists and select the relevant picking order.

Note: If the requested picking order is complete or removed, an error message "Order null does not exist, or is already finished" is displayed.

6. Validate the Pick Location.

To validate the pick location, scan the pick location code.

Note: In steps 6-9, if a user scans an invalid code, the user receives a notification that is displayed in the top right corner of the app. Furthermore, the user will hear an error sound that informs about the failed scan.

7. Validate the Article.

To validate the article, scan the article code.

8. Validate the Amount.

To validate the amount, say the number of articles to be picked (e.g. Say "Pick 25").

9. Validate the Place Location.

To validate the place location, scan the place location code.

10. End the task.

To end the task, select Finish Work

11. Optional: To continue working on other picking orders, select Next Order.

Process Exceptions

During the picking process, there are several available exceptions that can be chosen between steps 6 and 9. At any of these steps, the user can say Open exceptions to display the exceptions menu and can choose any of the exceptions mentioned below:

Note: Some exceptions might be configured in a way that they require additional confirmation, whereas others will be executed immediately when selected as seen from the exceptions below.

1- Early deposit

Cancels the rest of the order and triggers the deposit component after confirmation.

2- Cancel order

Cancels the current order after confirmation. The order cannot be requested again, and all remaining picks receive the Canceled status. There is no deposit, and the results file will be directly generated.

3- Error report

The user can generate and report errors by selecting Error Report

4- Pause order

The user can save the status of what has been picked and request the order again at a later point in time. To do this user must select the Pause order menu, the order pauses after confirmation.

5- Cancel pick

This cancels the current step. All picks in this step are marked as "Cancelled" and are skipped if the order is paused and requested again.

6- Pick selector

To start a step without following the picking sequence, the user must select the Pick Selector.

7- Postpone

Moves the current step to the end of the order. The user will receive a notification:

8- Call support

Starts an Assist call with an expert to receive remote support.

9- History

The history allows the user to view the results of previous picking steps. However, the user cannot make changes. The user navigates through picking steps with voice commands. The user sees the individual status of the picks included in one step that displays in different colours:

Green – Completed
Red – Canceled

To navigate within the history menu, use the voice commands Previous Step (takes the user to previous picking steps within the history menu) or Next Step (takes the user to next picking step within or out of the history menu).