How to Scrape Pricing, Date, and IBAN Data Using Python?

Date parsing

Suggested library — dateparser

Here, we parse a date in the German format; we could provide a hint of the library regarding the language for date formats:

d = dateparser.parse('2.Mai 2020', languages=['de'])

The results look great:

2020-05-02 00:00:00

We could try and pass all invalid dates to a library:

d = dateparser.parse('2.Abc 2020', languages=['de'])

Here, we would get such results that are ideal:

None

It’s time to parse the date without providing any hint about a language:

d = dateparser.parse('2020.12.8')

This works well also:

2020-12-08 00:00:00

Price parsing

Suggested library — price-parser

This could get more complicated with pricing parsing, just think about different currencies as well as different ways about how the pricing is written.

Let’s take a test using EUR price as well as comma like a decimal extractor:

p = Price.fromstring("-114,47 €")

The result - we find a number as well as currency symbol:

Price(amount=Decimal('-114.47'), currency='€')

Parse pricing in Russian rubles:

p = Price.fromstring("3 500 руб")

Output:

Price(amount=Decimal('11499'), currency='Rs')

Parse pricing in US dollars:

p = Price.fromstring("$1499.99")

Output:

Price(amount=Decimal('1499.99'), currency='$')

One more example, without any currency symbol, however with comma like a thousand extractor:

p = Price.fromstring("199,999.00")

The amount gets parsed appropriately:

Price(amount=Decimal('199999.00'), currency=None)

In case, we utilize the point like a decimal extractor:

p = Price.fromstring("199.999,00")

The results are correct also:

Price(amount=Decimal('199999.00'), currency=None)

IBAN parsing

Suggested library — schwifty

Test German IBAN number:

i = IBAN('DE89 3704 0044 0532 0130 00')

Result:

Country(alpha_2='DE', alpha_3='DEU', name='Germany', numeric='276', official_name='Federal Republic of Germany')

Test invalid IBAN:

try: i = IBAN('DE89 3704') print(i.country) except Exception as e: print(e)

Result like it might be anticipated in the case:

Invalid IBAN length

Conclusion

The step of data preparation is among the crucial steps in Machine Learning. Appropriate use of accessible libraries permits streamlining data processing. This blog teaches you how to procedure dates, currencies, and IBANs using web scraping services. For more details, contact Actowiz Solutions now!