List of Suggestions for Smart Vision improvement

[balmerjd]

I realize the Smart Vision feature is still technically “in beta” and I’ve not really seen anything from @Yarbo-Forum stating what the expected or planned future features are. After reading this post: possible improvement to docking as well as others making comments about how they would like to see the smart vision system used, I thought it might be a good idea to try to consolidate our thoughts. My initial proposal would be to start a list and for everyone who wants to add something, copy the list into your post with your additions. I’m not sure how best to handle “edit” or “counter suggestions” other than to add your change to the text of the relevant section with your user name before the text? I don’t know, but let’s give it a try.

1. Task map display
   1. When a task is paused, add a mini version of the direction controls like what’s on the Smart Vision screen in the app to allow for moving the rover while looking at the map. Also add a button to toggle the blades. I would definitely still leave the button for the full controller if needed.
   2. Add a button to pop up a small picture-in-picture single camera view that would default to the front camera. If you tap the view pop up, it cycles through the four cameras. Also include a button to swap whether the map is full screen with a PIP camera view, or whether the camera view is full screen and map is PIP.
2. SmartVision display
   1. Add a small button to switch between all four cameras and focusing on only a single camera.
      1. Maybe tapping the name of the view makes it single focus/maximize the view?
      2. Tapping back, goes back to the four camera view
      3. When in single camera view, small button in bottom right corner will cycle through the other cameras.
   2. When in single camera view
      1. Directional controller in bottom left
         1. Two buttons above control and to either side. One to activate blades/blower/auger, and one to initiate charging.
      2. Mini-map in bottom right
      3. Set which side left/right for 2.2.1 and 2.2.2 in Settings menu
      4. A set of controls should appear across the top (kept small) indicate BSOC, GPS strength, HaLow/Cellular/WiFi signal strength, maybe distance to nearest obstacle in direction of camera view?.
   3. Toggle to add straight line lane markers for front and rear view to aid in remote steering. Lines should indicate where tracks will hit the ground when driven in a straight line forward or backwards.
   4. Toggle to show alignment information for charging pad.
      1. I’m not sure how this is currently done, whether there’s a single magnet and an X-Y sensor, or if there are an array of magnets and sensors.
      2. Show each sensor with a red/yellow/green indication with position (left/right/front/back/etc.) so a user can steer the rover over the charging pad and align it.
      3. OR show some sort of targeting reticle (circle with an X that moves over a cross) that indicates what direction the rover should be moved in to align it for charging.
   5. Toggle for all lights???
   6. Maybe a mode slider at the top of the screen to set what viewing mode and controls should be displayed? Only allow first mode when task is in progress. If task is done, stopped, or paused, then allow all modes.
      1. General mode - four cameras or single camera, mic, speaker, and movement. maybe mini-map?
      2. Remote operation - Single camera, mini map, movement and attachment (blades/blower/etc) control
      3. Charging - four camera or single camera, senor status or target for aligning with charging pad, movement controls
   7. “Shutter” button to take individual picture from one or all four cameras at the same time.
   8. Movie button for APP to record streamed video from one camera or collage of all four cameras.
      1. The ROVER should only stream the video as it would in the current SmartVision screen. The rover should not be sending any special HD stream, or record the video.
      2. The PHONE APP should be responsible for any recording of video from a single camera or the collage of all four.
3. Add option to settings to take a picture with the cameras if a collision is detected.
   1. Maybe in the future add an option to have a recording loop buffer of a couple seconds of video that is triggered when a lift/drop/collision/motor overload event occurs. Keep it to only a few seconds to limit load on memory.

This is about everything I can remember reading or seeing mentioned in my adventures through the forum. As I said above, if you want to add to it, copy the list into your post and add to it. Got comments or changes? add them to the relevant section with your user name before the recommendation.

Let see what we all think!

[bryan.wheeler]

Great summary!

[jddockery2]

A good list. Swapping camera view based on controller input would be nice, with the PIP being a rear view possibly with a 3 second delay for quick course correction without spinning the view.

[rgloverii]

I like this!

To me, camera views should be a basic and fundamental part of Yarbo’s app strategy.

It’s time to add vision to the main UI controls and out of that obscure sub-menu placement.

These changes will really enhance the UX when remotely interacting with Yarbo.

[rcguymike]

1.2/2 is sorta doable currently,if you open the controller screen with the bottom right icon in smart vision and then click show mode button you get a dim view of the camera…would be nice if the dimming went away😅

[ken.w.gregory]

You can turn the lights on from the app. If the machine is charging, tap the blade or auger button to stop charging and then turn on the lights.

In case you didn’t already know this.

[rcguymike]

I didn’t want to bother stopping charge and restarting😁

[bryan.wheeler]

It is a lot of taps and nested menus to deal with.

[Yarbo-Forum]

Thanks for posting this thread to help collect feedback and suggestions on Smart Vision more effectively. And thank you as well for providing such a detailed and well-organized list of improvement ideas.

I’ve shared your suggestions, along with this entire post, with our product team. These kinds of consolidated feature proposals are extremely helpful for shaping future development.

I’ll also continue following this thread in case there are new updates or additional ideas from the community.

Thanks again for taking the time to put this together!

[balmerjd]

Ya, I was already aware of the “show mode" button and have used it in SmartVision and map views before when ole HAL9000 has gotten stuck in loops trying to navigate around obstacles, but it is very cumbersome to use and not at all efficient.

[steve]

I took @bryan.wheeler ‘s advice and paid out Bluestacks on my PC. Got the app running, cloned it, and now I run one Yarbo app instance with smartview, and a 2nd instance with either the map or the full control set exposed.

Not ideal, and it’s cheating, but it works for most anything other than no-go templates. It definitely makes daily map / job maintenance easier.

For no-go templates, I smartview on the PC and draw/edit on the phone. I’ve not been successful with using a mouse to rotate the templates on a PC, yet.