If you are using Selenium web driver with Python, you can use PyVirtualDisplay, a Python wrapper for Xvfb and Xephyr. PyVirtualDisplay needs Xvfb as a dependency. On Ubuntu, first install Xvfb: sudo apt-get install xvfb Then install PyVirtualDisplay from PyPI: pip install pyvirtualdisplay Sample Selenium script in Python in a headless mode with PyVirtualDisplay: #!/usr/bin/env … Read more
Have tried many things with respect to scroll, but the below code has provided better results. This will scroll until the element is in view: WebElement element = driver.findElement(By.id(“id_of_element”)); ((JavascriptExecutor) driver).executeScript(“arguments[0].scrollIntoView(true);”, element); Thread.sleep(500); //do anything you want with the element
import org.openqa.selenium.Keys WebElement.sendKeys(Keys.RETURN); The import statement is for Java. For other languages, it is maybe different. For example, in Python it is from selenium.webdriver.common.keys import Keys
If Ruby is your thing, you may also try: https://github.com/chriskite/anemone (dev stopped) https://github.com/sparklemotion/mechanize https://github.com/postmodern/spidr https://github.com/stewartmckee/cobweb http://watirwebdriver.com/ (Selenium) also, Nokogiri gem can be used for scraping: http://nokogiri.org/ there is a dedicated book about how to utilise nokogiri for scraping by packt publishing
Java Yes, it is possible. The following example is in Java: WebDriver driver = new FirefoxDriver(); driver.get(“http://www.google.com/”); File scrFile = ((TakesScreenshot)driver).getScreenshotAs(OutputType.FILE); // Now you can do whatever you need to do with it, for example copy somewhere FileUtils.copyFile(scrFile, new File(“c:\\tmp\\screenshot.png”));