Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Enhanced Urban Region Profiling with Adversarial Contrastive Learning (2402.01163v2)

Published 2 Feb 2024 in cs.CV

Abstract: Urban region profiling is influential for smart cities and sustainable development. However, extracting fine-grained semantics and generating robust urban region embeddings from noisy and incomplete urban data is challenging. In response, we present EUPAC (Enhanced Urban Region Profiling with Adversarial Contrastive Learning), a novel framework that enhances the robustness of urban region embeddings through joint optimization of attentive supervised and adversarial contrastive modules. Specifically, region heterogeneous graphs containing human mobility data, point of interest information, and geographic neighborhood details for each region are fed into our model, which generates region embeddings that preserve intra-region and inter-region dependencies through graph convolutional networks and multi-head attention. Meanwhile, we introduce spatially learnable augmentation to generate positive samples that are semantically similar and spatially close to the anchor, preparing for subsequent contrastive learning. Furthermore, we propose an adversarial training method to construct an effective pretext task by generating strong positive pairs and mining hard negative pairs for the region embeddings. Finally, we jointly optimize attentive supervised and adversarial contrastive learning to encourage the model to capture the high-level semantics of region embeddings while ignoring the noisy and irrelevant details. Extensive experiments on real-world datasets demonstrate the superiority of our model over state-of-the-art methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (32)
  1. Bruce F Berg. New York City Politics : Governing Gotham. Rutgers University Press, page 352, 2007.
  2. Region-wise attentive multi-view representation learning for urban region embedding. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, CIKM ’23, page 3763–3767, New York, NY, USA, 2023. Association for Computing Machinery.
  3. A simple framework for contrastive learning of visual representations. In Proceedings of the 37th International Conference on Machine Learning, ICML’20. JMLR.org, 2020.
  4. Efficient Region Embedding with Multi-View Spatial Networks: A Perspective of Locality-Constrained Spatial Autocorrelations. Proceedings of the AAAI Conference on Artificial Intelligence, 33(01):906–913, July 2019.
  5. Node2vec: Scalable Feature Learning for Networks, July 2016.
  6. Deep residual learning for image recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 770–778, 2016.
  7. Momentum contrast for unsupervised visual representation learning. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 9726–9735, 2020.
  8. Graphmae: Self-supervised masked graph autoencoders. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD ’22, page 594–604, New York, NY, USA, 2022. Association for Computing Machinery.
  9. Learning urban region representations with POIs and hierarchical graph infomax. ISPRS Journal of Photogrammetry and Remote Sensing, 196:134–145, February 2023.
  10. Pre-training on large-scale heterogeneous graph. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, KDD ’21, page 756–766, New York, NY, USA, 2021. Association for Computing Machinery.
  11. Joint Representation Learning for Multi-Modal Transportation Recommendation. Proceedings of the AAAI Conference on Artificial Intelligence, 33(01):1036–1043, July 2019.
  12. Self-supervised learning: Generative or contrastive. IEEE Transactions on Knowledge and Data Engineering, 35(1):857–876, 2023.
  13. Urban region profiling via multi-graph representation learning. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management, CIKM ’22, page 4294–4298, New York, NY, USA, 2022. Association for Computing Machinery.
  14. A primer on contrastive pretraining in language processing: Methods, lessons learned, and perspectives. ACM Comput. Surv., 55(10), feb 2023.
  15. Infograph: Unsupervised and semi-supervised graph-level representation learning via mutual information maximization. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020. OpenReview.net, 2020.
  16. Adversarial graph augmentation to improve graph contrastive learning. In M. Ranzato, A. Beygelzimer, Y. Dauphin, P.S. Liang, and J. Wortman Vaughan, editors, Advances in Neural Information Processing Systems, volume 34, pages 15920–15933. Curran Associates, Inc., 2021.
  17. Line: Large-scale information network embedding. In Proceedings of the 24th International Conference on World Wide Web, WWW ’15, page 1067–1077, Republic and Canton of Geneva, CHE, 2015. International World Wide Web Conferences Steering Committee.
  18. What makes for good views for contrastive learning? In Proceedings of the 34th International Conference on Neural Information Processing Systems, NIPS’20, Red Hook, NY, USA, 2020. Curran Associates Inc.
  19. Attention Is All You Need, December 2017.
  20. Region Representation Learning via Mobility Flow. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pages 237–246, Singapore Singapore, November 2017. ACM.
  21. Self-supervised heterogeneous graph neural network with co-contrastive learning. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, KDD ’21, page 1726–1736, New York, NY, USA, 2021. Association for Computing Machinery.
  22. Molecular contrastive learning of representations via graph neural networks. Nat Mach Intell, 4(3):279–287, March 2022.
  23. Iterative reorganization with weak spatial constraints: Solving arbitrary jigsaw puzzles for unsupervised representation learning. In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 1910–1919, 2019.
  24. Multi-Graph Fusion Networks for Urban Region Embedding, May 2022.
  25. Self-supervised learning of graph neural networks: A unified review. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(2):2412–2429, 2023.
  26. Representing Urban Functions through Zone Embedding with Human Mobility Patterns. In Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, pages 3919–3925, Stockholm, Sweden, July 2018. International Joint Conferences on Artificial Intelligence Organization.
  27. Graph contrastive learning with augmentations. In H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin, editors, Advances in Neural Information Processing Systems, volume 33, pages 5812–5823. Curran Associates, Inc., 2020.
  28. Regions, Periods, Activities: Uncovering Urban Dynamics via Cross-Modal Representation Learning. In Proceedings of the 26th International Conference on World Wide Web, pages 361–370, Perth Australia, April 2017. International World Wide Web Conferences Steering Committee.
  29. Unifying Inter-region Autocorrelation and Intra-region Structures for Spatial Embedding via Collective Adversarial Learning. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 1700–1708, Anchorage AK USA, July 2019. ACM.
  30. Multi-View Joint Graph Representation Learning for Urban Region Embedding. In Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, pages 4431–4437, Yokohama, Japan, July 2020. International Joint Conferences on Artificial Intelligence Organization.
  31. Automated spatio-temporal graph contrastive learning. In Proceedings of the ACM Web Conference 2023, WWW ’23, page 295–305, New York, NY, USA, 2023. Association for Computing Machinery.
  32. Heterogeneous Region Embedding with Prompt Learning. AAAI, 37(4):4981–4989, June 2023.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (5)
  1. Qianqian Ren (8 papers)
  2. Jinbao Li (9 papers)
  3. Weiliang Chen (14 papers)
  4. Lin Pan (23 papers)
  5. Shengxi Fu (2 papers)

Summary

We haven't generated a summary for this paper yet.