[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[bug#55044] [PATCH 8/8] gnu: Add python-scrapy.
From: |
Felix Gruber |
Subject: |
[bug#55044] [PATCH 8/8] gnu: Add python-scrapy. |
Date: |
Wed, 20 Apr 2022 17:28:04 +0000 |
* gnu/packages/python-web.scm (python-scrapy): New variable.
---
gnu/packages/python-web.scm | 60 +++++++++++++++++++++++++++++++++++++
1 file changed, 60 insertions(+)
diff --git a/gnu/packages/python-web.scm b/gnu/packages/python-web.scm
index da3f9cf980..f4ff4f494c 100644
--- a/gnu/packages/python-web.scm
+++ b/gnu/packages/python-web.scm
@@ -6519,3 +6519,63 @@ by asyncio.")
HTML and XML using XPath and CSS selectors, optionally combined with
regular expressions.")
(license license:bsd-3)))
+
+(define-public python-scrapy
+ (package
+ (name "python-scrapy")
+ (version "2.6.1")
+ (source
+ (origin
+ (method url-fetch)
+ (uri (pypi-uri "Scrapy" version))
+ (sha256
+ (base32 "09rqalbwcz9ix8h0992mzjs50sssxsmmh8w9abkrqchgknjmbzan"))))
+ (build-system python-build-system)
+ (arguments
+ `(#:phases
+ (modify-phases %standard-phases
+ (replace 'check
+ (lambda* (#:key tests? #:allow-other-keys)
+ (when tests?
+ (invoke "pytest"
+ ;; requires network access
+ "--ignore" "tests/test_command_check.py"
+ "-k"
+ (string-append
+ ;; Failing for unknown reasons
+ "not
test_server_set_cookie_domain_suffix_public_private"
+ " and not
test_user_set_cookie_domain_suffix_public_private"
+ " and not test_pformat")
+ "tests")))))))
+ (propagated-inputs
+ (list python-botocore ; Optional: For S3FeedStorage class.
+ python-cryptography
+ python-cssselect
+ python-itemadapter
+ python-itemloaders
+ python-lxml
+ python-parsel
+ python-protego
+ python-pydispatcher
+ python-pyopenssl
+ python-queuelib
+ python-service-identity
+ python-setuptools
+ python-tldextract
+ python-twisted
+ python-w3lib
+ python-zope-interface))
+ (native-inputs
+ (list python-pytest
+ python-pyftpdlib
+ python-sybil
+ python-testfixtures
+ python-uvloop
+ ))
+ (home-page "https://scrapy.org")
+ (synopsis "A high-level Web Crawling and Web Scraping framework")
+ (description "Scrapy is a fast high-level web crawling and web
+scraping framework, used to crawl websites and extract structured data
+from their pages. It can be used for a wide range of purposes, from data
+mining to monitoring and automated testing.")
+ (license license:bsd-3)))
--
2.30.2
- [bug#55044] [PATCH 0/8] Add python-scrapy., Felix Gruber, 2022/04/20
- [bug#55044] [PATCH 3/8] gnu: Add python-queuelib., Felix Gruber, 2022/04/20
- [bug#55044] [PATCH 1/8] gnu: Add python-sybil., Felix Gruber, 2022/04/20
- [bug#55044] [PATCH 6/8] gnu: Add python-parsel., Felix Gruber, 2022/04/20
- [bug#55044] [PATCH 7/8] gnu: Add python-itemloaders., Felix Gruber, 2022/04/20
- [bug#55044] [PATCH 4/8] gnu: Add python-itemadapter., Felix Gruber, 2022/04/20
- [bug#55044] [PATCH 2/8] gnu: Add python-pydispatcher., Felix Gruber, 2022/04/20
- [bug#55044] [PATCH 5/8] gnu: Add python-protego., Felix Gruber, 2022/04/20
- [bug#55044] [PATCH 8/8] gnu: Add python-scrapy.,
Felix Gruber <=