Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix segments ending on limbs #948

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Fix segments ending on limbs #948

wants to merge 1 commit into from

Conversation

h3ndrk
Copy link
Member

@h3ndrk h3ndrk commented Apr 19, 2024

Introduced Changes

Previously:

Screenshot from 2024-04-19 14-43-29

With this PR:

Screenshot from 2024-04-19 19-36-14

ToDo / Known Issues

  • We need to tune the limbs because now we have short segments near them

Ideas for Next Iterations (Not This PR)

It's perfect

How to Test

Deploy on a NAO and look through the bottom camera

@h3ndrk h3ndrk enabled auto-merge April 19, 2024 17:43
@Irwinlim1097 Irwinlim1097 self-assigned this Apr 20, 2024
@h3ndrk h3ndrk disabled auto-merge April 20, 2024 07:16
@knoellle
Copy link
Contributor

What is blocking this PR? I thought this had been merged already. :D

I was looking through the replay from the game against Nao Devils and was confused why this wasn't in the game branch.
Did we forget to merge-squash this into the game branch?

@h3ndrk
Copy link
Member Author

h3ndrk commented Apr 23, 2024

What is blocking this PR?

I have written it in the description:

We need to tune the limbs because now we have short segments near them

In its current form, it will likely have a large impact on other detection algorithms.

Maybe we should move this back to In Progress? @Irwinlim1097 and @MeiiMoon said they want to continue work on it. Is this still correct?

@Irwinlim1097
Copy link

Yes me and @MeiiMoon were looking into this code during GO, as we wanted to learn more about the whole Hulks code in general. If this has to be merged into main I could help review it, else it could be moved to In Progress.

@h3ndrk
Copy link
Member Author

h3ndrk commented Apr 23, 2024

@Irwinlim1097 @MeiiMoon then feel free to take this over from me, improve the limbs, and bring this into main. I will move it back to In Progress and assign you two. I'll be in the lab tomorrow, if you have questions.

@larskna larskna enabled auto-merge May 29, 2024 12:29
@larskna larskna disabled auto-merge May 29, 2024 12:29
@schluis schluis removed the GO24 label Jul 3, 2024
@knoellle
Copy link
Contributor

knoellle commented Jul 6, 2024

What is the state here?
As I recall, this fix has a decent amount of potential to improve our vision but we seem to have forgotten about it.
Can we get this done before robocup?

@h3ndrk
Copy link
Member Author

h3ndrk commented Jul 7, 2024

Main problem is the lag between image and camera matrix. Therefore the limbs are lagging and the segmenter produces segments on limbs. One hacky idea was to increase limb size but that will have other drawbacks. The proper fix would be to reduce lag.

@Irwinlim1097 @MeiiMoon What is your state?

@knoellle
Copy link
Contributor

knoellle commented Jul 7, 2024

Ok, then I would suggest check again with #1107.
From what we can tell, this should completely get rid of the relative delay between camera matrix and image capture.

@h3ndrk
Copy link
Member Author

h3ndrk commented Jul 7, 2024

Since my time with a NAO is limited, feel free to test it for me 💪

@schluis schluis added the RC24 label Jul 14, 2024
@MeiiMoon
Copy link
Contributor

I tested the respective "limbo" branch, and the delay from the sensors still cause the robots body part to occasionally exceed the projected limbs. Therefore, the delay problem still has to be solved, because the current state would cause problem for the localization.

@schluis schluis added is:Postponed and removed RC24 labels Jul 15, 2024
@rmburg rmburg mentioned this pull request Jul 15, 2024
@h3ndrk h3ndrk force-pushed the limbo branch 3 times, most recently from 0f5dc94 to eac208a Compare July 17, 2024 09:56
@oleflb
Copy link
Contributor

oleflb commented Dec 18, 2024

@MeiiMoon is this a problem? If it improves on the current situation we should merge it

@MeiiMoon
Copy link
Contributor

@oleflb When we were in Eindhoven, I had a talk with @h3ndrk and he said there is some issue here that beginner will not be able to solve. Unfortunately I cannot remember what exactly was the problem. So that's why I left this task, but I also did not update it further.

@knoellle
Copy link
Contributor

The problem is detailed here:

Main problem is the lag between image and camera matrix. Therefore the limbs are lagging and the segmenter produces segments on limbs. One hacky idea was to increase limb size but that will have other drawbacks. The proper fix would be to reduce lag.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Request for Review
Development

Successfully merging this pull request may close these issues.

7 participants