Как извлечь JSON из HTML кода?

Question

У меня есть вот такой HTML элемент:

<script type="application/ld+json">&#13;
    {&#13;
  "@context": "http://schema.org",&#13;
  "BaseSalary": {&#13;
    "Currency": "USD",&#13;
    "Value": {&#13;
      "UnitText": "YEAR",&#13;
      "@type": "QuantitativeValue"&#13;
    },&#13;
    "@type": "MonetaryAmount"&#13;
  },&#13;
  "DatePosted": "2020-05-15T05:04:20.193",&#13;
  "EducationRequirements": "",&#13;
  "EmploymentType": [&#13;
    "FULL_TIME"&#13;
  ],&#13;
  "ExperienceRequirements": "",&#13;
  "Identifier": "927323",&#13;
  "HiringOrganization": {&#13;
    "Name": "Staples Stores",&#13;
    "@type": "Organization"&#13;
  },&#13;
  "JobLocation": {&#13;
    "Address": {&#13;
      "AddressLocality": "Elgin",&#13;
      "AddressRegion": "IL",&#13;
      "AddressCountry": "US",&#13;
      "PostalCode": "60123",&#13;
      "@type": "PostalAddress"&#13;
    },&#13;
    "Geo": {&#13;
      "Latitude": 42.03891,&#13;
      "Longitude": -88.31189,&#13;
      "@type": "GeoCoordinates"&#13;
    },&#13;
    "@type": "Place"&#13;
  },&#13;
  "Title": "Xerox Certified iGen Operator",&#13;
  "@type": "JobPosting"&#13;
}&#13;
</script>&#13;

Надо текст, заключенный в тег <script>, извлечь в виде JSON, чтобы удобнее было с ним работать.

Answer 1

https://ideone.com/AQm09c

import re
import html
import json

s= """j kj klajkldj lkdjslak jk
<script type="application/ld+json">&#13;
    {&#13;
  "@context": "..."&#13;
    }&#13;
</script>&#13;
ds ad sad ksalkd l;ask;l"""

print(
  json.loads(
    html.unescape(
      re.search(
        r"""<script\s+type\s*=\s*(["']?)application/ld\+json\1\s*>((?:(?!</script>)[\s\S])+)</script>""",
        s
      ).group(2)
    )
  )
)

Answer 2

Можно обработать html с помощью lxml:

# Сократил html из вопроса, чтобы не занимать лишнее место в ответе
text = '''
<script type="application/ld+json">&#13;
    {&#13;
  "@context": "http://s...content-available-to-author-only...a.org"&#13;
}&#13;
</script>&#13;
'''
 
import json
import html
import lxml.html

data = lxml.html.fromstring(text)
print(json.loads(
    html.unescape(
        data.xpath('//script[@type="application/ld+json"]/text()')[0])))

Вывод:

{'@context': 'http://s...content-available-to-author-only...a.org'}

БЛОГ НА HUSL

Как извлечь JSON из HTML кода?

Ответы (2 шт):