Skip to content

Add Metric Depth Estimation (DAv3)#776

Open
mrpositron wants to merge 7 commits into
mainfrom
nauryzbay-trn-2132-add-metric-depth-estimation-for-dav3
Open

Add Metric Depth Estimation (DAv3)#776
mrpositron wants to merge 7 commits into
mainfrom
nauryzbay-trn-2132-add-metric-depth-estimation-for-dav3

Conversation

@mrpositron

@mrpositron mrpositron commented Jun 12, 2026

Copy link
Copy Markdown
Contributor

What has changed and why?

Adds metric depth estimation for Depth Anything V3. The new DepthAnythingV3MetricDepthEstimation task model (dinov2/dav3-metric-large) reuses the relative model's backbone and DPT decoder, and scales the output to metric units via metric_depth = focal * output / 300 when camera intrinsics are given. dpt.py is moved to the shared depth_estimation_components/ package, and convert_checkpoint.py now also converts the official DA3METRIC-LARGE weights.

How has it been tested?

NYUv2 Benchmark:

Model a1 ↑ a2 ↑ a3 ↑ abs_rel ↓ log_10 ↓ rmse ↓ rmse_log ↓ silog ↓ sq_rel ↓
Official Implementation 0.948 0.984 0.992 0.08 0.036 0.342 0.116 9.112 0.047
LightlyTrain Port 0.948 0.984 0.992 0.08 0.036 0.342 0.116 9.103 0.046

Did you update CHANGELOG.md?

  • Yes
  • Not needed (internal change)

Did you update the documentation?

  • Yes
  • Not needed (internal change without effects for user)

@mrpositron mrpositron marked this pull request as ready for review June 12, 2026 13:29
@mrpositron

Copy link
Copy Markdown
Contributor Author

@codex

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Nice work!

Reviewed commit: 0fdc355e6a

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@mrpositron mrpositron changed the title Add Metric Depth Estimaiton (DAv3) Add Metric Depth Estimation (DAv3) Jun 12, 2026
@mrpositron

Copy link
Copy Markdown
Contributor Author

/review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant