torchobject Namespace Reference

Namespace containing functions related to torch object detections operations on images using PyTorch. More...

Functions
std::vector< objectdetectutils::Object >	Detect (const cv::Mat &cvFrame, yolomodel::pytorch::PyTorchInterpreter &trPyTorchDetector, const float fMinObjectConfidence=0.40f, const float fNMSThreshold=0.60f)
	Detects objects in the given image using a PyTorch model.
void	DrawDetections (cv::Mat &cvDetectionsFrame, const std::vector< objectdetectutils::Object > &vDetectedTags)
	Given a vector of objectdetectutils::Object structs draw each tag corner and confidence onto the given image.

Detailed Description

Namespace containing functions related to torch object detections operations on images using PyTorch.

Author

clayjay3 (clayt.nosp@m.onra.nosp@m.ycowe.nosp@m.n@gm.nosp@m.ail.c.nosp@m.om)

Date

2025-05-05

Function Documentation

Detect()

std::vector< objectdetectutils::Object > torchobject::Detect ( const cv::Mat &  cvFrame, yolomodel::pytorch::PyTorchInterpreter &  trPyTorchDetector, const float  fMinObjectConfidence = 0.40f, const float  fNMSThreshold = 0.60f  )

inline

Detects objects in the given image using a PyTorch model.

Parameters

cvFrame	- The image to detect objects in.
trPyTorchDetector	- The PyTorch model to use for detection.
fMinObjectConfidence	- The minimum confidence threshold for detected objects.
fNMSThreshold	- The non-maximum suppression threshold for detected objects.

Returns

std::vector<objectdetectutils::Object> - A vector of detected objects.

Author

clayjay3 (clayt.nosp@m.onra.nosp@m.ycowe.nosp@m.n@gm.nosp@m.ail.c.nosp@m.om)

Date

2025-05-09

    {
        // Check if the input frame is in RGB format.
        if (cvFrame.channels() != 3)
        {
            // Submit logger message.
            LOG_ERROR(logging::g_qSharedLogger, "Detect() requires a RGB image.");
            return {};
        }
 
        // Declare instance variables.
        std::vector<objectdetectutils::Object> vDetectedTags;
 
        // Check if the PyTorch interpreter hardware is opened and the model is loaded.
        if (trPyTorchDetector.IsReadyForInference())
        {
            // Run inference on YOLO model with current image.
            std::vector<yolomodel::Detection> vOutputTensorTags = trPyTorchDetector.Inference(cvFrame, fMinObjectConfidence, fNMSThreshold);
 
            // Repackage detections into tensorflow tags.
            for (const yolomodel::Detection& stTagDetection : vOutputTensorTags)
            {
                // Create and initialize new TensorflowTag.
                objectdetectutils::Object stDetectedTag;
                stDetectedTag.dConfidence       = stTagDetection.fConfidence;
                stDetectedTag.pBoundingBox      = std::make_shared<cv::Rect2d>(stTagDetection.cvBoundingBox);
                stDetectedTag.szClassName       = stTagDetection.szClassName;
                stDetectedTag.eDetectionMethod  = objectdetectutils::ObjectDetectionMethod::eTorch;
                stDetectedTag.cvImageResolution = cvFrame.size();
 
                // Add the newly detected tag to the vector.
                vDetectedTags.emplace_back(stDetectedTag);
            }
        }
        else
        {
            // Submit logger message.
            LOG_WARNING(logging::g_qSharedLogger,
                        "TorchDetect: Unable to detect tags using YOLO torch detection because hardware is not opened or model is not initialized.");
        }
 
        // Return the detected tags.
        return vDetectedTags;
    }

Here is the call graph for this function:

Here is the caller graph for this function:

DrawDetections()

void torchobject::DrawDetections ( cv::Mat &  cvDetectionsFrame, const std::vector< objectdetectutils::Object > &  vDetectedTags  )

inline

Given a vector of objectdetectutils::Object structs draw each tag corner and confidence onto the given image.

Parameters

cvDetectionsFrame	- The frame to draw overlay onto.
vDetectedTags	- The vector of objectdetectutils::Object structs used to draw tag corners and confidences onto image.

Author

clayjay3 (clayt.nosp@m.onra.nosp@m.ycowe.nosp@m.n@gm.nosp@m.ail.c.nosp@m.om)

Date

2025-02-13

    {
        // Check if the given frame is a 1 or 3 channel image. (not BGRA)
        if (!cvDetectionsFrame.empty() && (cvDetectionsFrame.channels() == 1 || cvDetectionsFrame.channels() == 3))
        {
            // Loop through each detection.
            for (const objectdetectutils::Object& stTag : vDetectedTags)
            {
                // Check if the tag detection type is Torch.
                if (stTag.eDetectionMethod == objectdetectutils::ObjectDetectionMethod::eTorch)
                {
                    // Draw bounding box onto image.
                    cv::rectangle(cvDetectionsFrame, *stTag.pBoundingBox, cv::Scalar(255, 255, 255), 2);
                    std::string szText  = stTag.szClassName + " " + std::to_string(static_cast<int>(stTag.dConfidence * 100)) + "%";
                    cv::Size cvTextSize = cv::getTextSize(szText, cv::FONT_HERSHEY_SIMPLEX, 0.75, 1, nullptr);
                    // Draw classID background box onto image.
                    cv::rectangle(cvDetectionsFrame,
                                  stTag.pBoundingBox->tl() + cv::Point2d(0, stTag.pBoundingBox->height),
                                  stTag.pBoundingBox->tl() + cv::Point2d(cvTextSize.width, stTag.pBoundingBox->height + cvTextSize.height),
                                  cv::Scalar(255, 255, 255),
                                  cv::FILLED);
                    // Draw class text onto image.
                    cv::putText(cvDetectionsFrame,
                                szText,
                                stTag.pBoundingBox->tl() + cv::Point2d(0, stTag.pBoundingBox->height + cvTextSize.height),
                                cv::FONT_HERSHEY_SIMPLEX,
                                0.5,
                                cv::Scalar(0, 0, 0));
                }
            }
        }
        else
        {
            // Submit logger message.
            LOG_ERROR(logging::g_qSharedLogger,
                      "TorchDetect: Unable to draw markers on image because it is empty or because it has {} channels. (Should be 1 or 3)",
                      cvDetectionsFrame.channels());
        }
    }

Here is the call graph for this function:

Here is the caller graph for this function: