Table of content (short-version) [paper]


Summary

  • ์ถ”๊ฐ€์ ์ธ ๋ณด์กฐ๊ธฐ๋ฒ•(pose, parsing) ์—†์ด ๋‹ค์–‘ํ•œ discriminative visual cue๋ฅผ ํ™•๋ณดํ•˜๊ธฐ ์œ„ํ•œ ๋ฐฉ๋ฒ•
    • ๊ธฐ์กด์˜ CAM ๋ฐฉ์‹์€ ๊ฐ€์žฅ activated ๋˜๋Š” ์˜์—ญ๋งŒ ๋ณด์—ฌ์ค€๋‹ค.
    • ํ•˜์ง€๋งŒ overlapped activation panalty๋ฅผ ํ†ตํ•ด ํ•™์Šต์‹œ ๋œ activate ๋œ ๋ถ€๋ถ„๊นŒ์ง€ ์ง‘์ค‘ํ•  ์ˆ˜ ์žˆ๋‹ค(๋ชธ ์ „์ฒด ์˜์—ญ์„ ๊ณ ๋ฅด๊ฒŒ ๋ถ„์„ํ•  ์ˆ˜ ์žˆ๋‹ค).
    • Multi-branch ๊ตฌ์กฐ๋ฅผ ํ†ตํ•ด ๊ฐ๊ฐ ๋‹ค๋ฅธ ์˜์—ญ์„ ๊ณ ๋ ค
    • ์ด๋ฅผ ํ†ตํ•ด ํ…Œ์ŠคํŠธํ•  ๋•Œ ๋ณด๋‹ค ์—ฌ๋Ÿฌ๊ฐœ์˜ ๋‹จ์„œ๋ฅผ ๊ฐ€์ง€๊ณ  ๋งค์นญํ•  ์ˆ˜ ์žˆ๋‹ค.
  • ์ƒˆ๋กœ์šด visualization ๊ธฐ๋ฒ•์ธ ranking activation map์„ ์ œ์•ˆ
    • ํ…Œ์ŠคํŠธ์—์„œ query์™€ gallery ์‚ฌ์ด์˜ ๊ด€๋ จ๋œ ์‹œ๊ฐ์  ํŠน์ง•์„ ๋ฐ”๋กœ ํ•ด์„ ๊ฐ€๋Šฅ
    • REID๋ถ„์•ผ์—์„œ query-gallery ranking ๊ฒฐ๊ณผ ํ•ด์„ ๊ฐ€๋Šฅ


[RAM ์ปจ์…‰]

picture

  • ์ „์ฒด ํ”„๋ ˆ์ž„์›Œํฌ
    • ResNet50 backbone(conv4๊นŒ์ง€) ์ดํ›„์— conv5๋ถ€ํ„ฐ 3๊ฐœ์˜ branch ์กด์žฌ
    • ๊ฐ branch๋ณ„๋กœ GAP + softmax๋ฅผ ํ†ตํ•ด class score ์ถ”์ •
    • ๊ฐ branch๋ณ„๋กœ CAM ์ ์šฉ
    • Overlapped Activation Penalty (OAP)๋ฅผ ํ†ตํ•ด CAM์— ์˜ํ•ด activate ๋˜๋Š” ๊ฒฐ๊ณผ ๋‹ฌ๋ผ์ง€๋„๋ก ํ•™์Šต
    • OAP์™€ CE loss์˜ ๊ท ํ˜•์„ ํ†ตํ•ด ํ•™์Šต
    • Ranking Activation Map (RAM)๋ฅผ ํ†ตํ•ด ๊ฒฐ๊ณผํ™•์ธ


[์ „์ฒด ํ”„๋ ˆ์ž„์›Œํฌ]

picture


[Ranking Activation Map(RAM)]

picture


[Branch๋ณ„ RAM ๊ฒฐ๊ณผ์™€ aggregated ๊ฒฐ๊ณผ]

picture


References

[1] Yang, Wenjie, et al. โ€œTowards Rich Feature Discovery with Class Activation Maps Augmentation for Person Re-Identification.โ€ Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2019.