Detect the orientation of an object

bjoern

Dear all,

I have to program a pick and place application. The robot needs to detect objects of size 50mm x 3mm. On one side they are white and on the other side they are green on the bottom and yellow on the top. We need to pick the objects and place them into a tray with the yellow side to the top and the green side on the bottom. The objects are made available to the robot on a vibrating plate.

Hardware setup: UR5e with a wrist camera and a customized ePick solution.

The detection of the objects is working well on a white background. But I cannot control the orientation of the parts. Sometime the yellow side is on top and sometimes the green side.

Any suggestions on how this can be solved?

Thanks a lot,
Björn

MattFanguy

You could program multiple models, and have a different color constraint for each.

For example, you would have two different "Camera Locate" Nodes in your program each trained to look for the same object, but with different color constraints. Your program might would start by taking a snapshot and detecting only the green colored objects of interest. If it sees yellow, it will ignore them no matter how confident it is in their shape recognition. You would then have a pick and place process within that Camera Locate node to flip over the green ones, place them where they need to go, and then return to the snapshot position when it has looped through all the green detected objects.

After that, you'd have your second Camera Locate node directly after the first one to take another snapshot, detect the yellow ones, and repeat the pick and place process this time without flipping them.

Hope this helps!

bjoern

Hi Matt,

thanks a lot for your answer.

Seems my description of the objects was not very precise. There is only one type of object not different ones. The objects are white on one side and yellow and green on the other side. Regarding the yellow and green side they are yellow on the upper half of that side and green on the lower part. So the size of the colored are is 1,5mm+5mm and the green part as well 1,5mm + 50mm. As a consequence two "Camera Locate" will not do the trick.

Maybe the distance to the objects is yet too far away but the camera is currently not able to detect if the object has the yellow part on top or the green one. I will try to locate the objects a bit closer, but maybe there is another possible solution out there...

Kind regards,
Björn