Integrate a camera-based object detection module into Arduin

Hi ,

I need to use opencv to write some code to recognize the obstacles(rocks) in images so as to let the robot to avoid these rocks and move forward with a best way.

However, I can use c++ and python to write the code to implement the object recognition function , but the Arduino does not support the the language I use.(the object recognition function can be a separate module with a different language and then be integrated into Arduino board?)

How to integrate the recognition module into the Arduino board?

xuehao.hu@gmail.com

Arduino is a kind of C/C++, so it is unlikely to be impossible to port it. But this would be a project for quite advanced programmers. I don’t know how or if there are python ports for Arduino.

But the major question is probably if the Arduino hardware module you are going to use is capable of processing the data that the recognition module generates. Most Arduino boards are quite limited in their processing power and memory capacity. Hmm, which one was it again? You must have explained it already, didn’t you?

Consider the Pixy (CMUCam5) from Charmed Labs. It has a built in processor that does color-based object recognition, and is open source so you could reprogram it.

  1. Sorry~what do you mean by “which one was it again?”

  2. Could you give some specific details about integrating C/C++ based image process module? (I am a CS student and do not much about integration)

3.Yes, the processing power and limited memory are the problems. So is it possible to use another board for image process and return the process to Arduino? That being said, it possible/how to let a image-process-based board work perfectly with Arduino Due?

Valen:
Arduino is a kind of C/C++, so it is unlikely to be impossible to port it. But this would be a project for quite advanced programmers. I don’t know how or if there are python ports for Arduino.

But the major question is probably if the Arduino hardware module you are going to use is capable of processing the data that the recognition module generates. Most Arduino boards are quite limited in their processing power and memory capacity. Hmm, which one was it again? You must have explained it already, didn’t you?

Is it possible to let CMUCam5 work perfectly with Arduino?(Since We are required to use a Arduino-based beacon receiver to receive direction signal to let the automatic robot move forward)

jremington:
Consider the Pixy (CMUCam5) from Charmed Labs. It has a built in processor that does color-based object recognition, and is open source so you could reprogram it.

xuehaohu:

  1. Sorry~what do you mean by “which one was it again?”

That was a hint at the lack of information about the kind of Arduino and object detection module.

  1. Could you give some specific details about integrating C/C++ based image process module? (I am a CS student and do not much about integration)

No, sorry. Way over my head.

3.Yes, the processing power and limited memory are the problems. So is it possible to use another board for image process and return the process to Arduino? That being said, it possible/how to let a image-process-based board work perfectly with Arduino Due?

Don’t know.

Is it possible to let CMUCam5 work perfectly with Arduino?

Yes.

jremington:

Is it possible to let CMUCam5 work perfectly with Arduino?

Yes.

Sorry - more practical questions:

Q1: the time used to process the detection and power will require what kind of battery? (It may need a long code work to implement the detection and select a best way to move forward)

Q2: Is it possible to make the camera work when sun light influence its focus?( and can not see things in front it, does it work when adding a pair of sun glasses )( since our robot will work outside in a national park to navigate different terrain, there may have hot sun)

I think you should be reading the CMUcam website. There will be more info there than people here can give.

Thanks~~~