Today we present to you the new sharer section to share everything you want: text, videos, images, links. This features are reserved for registered users who have filled the profile with personal informations: the sharer of MYETV can be used only if the user is logged in and have compiled the personal informations section. The sharer is a powerfull crawler application client/server or server/server or client/client (with the help of a centralized p2p net). Results are usually cached to reduce the load of the application and the possibilities of abuses. The sharer can cover every existing URL out there only via HTTPS:// but is builded to work better with ograph or oexchange protocolls or any structured data contained a title a description and an image. The sharer will produce a preview that could be not the same as the post, it can be edited and some advanced features can be available after the content is shared in the “edit content” page.
What is Web Scraping?
Web scraping, web harvesting, or web data extraction is data scraping used for extracting data from websites. Web scraping software may access the World Wide Web directly using the Hypertext Transfer Protocol, or through a web browser. While web scraping can be done manually by a software user, the term typically refers to automated processes implemented using a bot or web crawler. It is a form of copying, in which specific data is gathered and copied from the web, typically into a central local database or spreadsheet, for later retrieval or analysis.
Web scraping a web page involves fetching it and extracting from it. Fetching is the downloading of a page (which a browser does when a user views a page). Therefore, web crawling is a main component of web scraping, to fetch pages for later processing. Once fetched, then extraction can take place. The content of a page may be parsed, searched, reformatted, its data copied into a spreadsheet, and so on. Web scrapers typically take something out of a page, to make use of it for another purpose somewhere else. An example would be to find and copy names and telephone numbers, or companies and their URLs, to a list (contact scraping).
Web scraping is used for contact scraping, and as a component of applications used for web indexing, web mining and data mining, online price change monitoring and price comparison, product review scraping (to watch the competition), gathering real estate listings, weather data monitoring, website change detection, research, tracking online presence and reputation, web mashup and, web data integration.
Web pages are built using text-based mark-up languages (HTML and XHTML), and frequently contain a wealth of useful data in text form. However, most web pages are designed for human end-users and not for ease of automated use. As a result, specialized tools and software have been developed to facilitate the scraping of web pages.
Newer forms of web scraping involve listening to data feeds from web servers. For example, JSON is commonly used as a transport storage mechanism between the client and the web server.
There are methods that some websites use to prevent web scraping, such as detecting and disallowing bots from crawling (viewing) their pages. In response, there are web scraping systems that rely on using techniques in DOM parsing, computer vision and natural language processing to simulate human browsing to enable gathering web page content for offline parsing.
Source: Web scraping – Wikipedia
MYETV makes this process easier and faster than normal, thanks to the worldwide CDN the system is able to contact and cache any website in seconds and on demand; the new sharer will guide the user throughout the process.
How does the MYETV Sharer work?
Follow these basic rules to share URLs:
- Must be HTTPS:// (we have an HSTS high security settings)
- URL must be publicly available at the moment of the share/view
- Cannot contain harmful extensions
- It must point to a “text/html” content type
- Sharing images or video directly are not supported unless they come from verified 3rd party website
To share images or video the MYCLOUD is available with space and speed limitations.
MORE INFORMATIONS AND UPDATES
That’s all folks! Have a nice day! ;)