I see the discussions still talk about the old way of setting up chromedriver by downloading the binary and configuring the path manually. This can be done automatically using webdriver-manager pip install webdriver-manager Now the above code in the question will work simply with below change, from selenium import webdriver from webdriver_manager.chrome import ChromeDriverManager driver … Read more
Try the following: driver.find_elements_by_xpath(“//*[contains(text(), ‘My Button’)]”)
If Ruby is your thing, you may also try: https://github.com/chriskite/anemone (dev stopped) https://github.com/sparklemotion/mechanize https://github.com/postmodern/spidr https://github.com/stewartmckee/cobweb http://watirwebdriver.com/ (Selenium) also, Nokogiri gem can be used for scraping: http://nokogiri.org/ there is a dedicated book about how to utilise nokogiri for scraping by packt publishing
You can use document.evaluate: Evaluates an XPath expression string and returns a result of the specified type if possible. It is w3-standardized and whole documented: https://developer.mozilla.org/en-US/docs/Web/API/Document.evaluate function getElementByXpath(path) { return document.evaluate(path, document, null, XPathResult.FIRST_ORDERED_NODE_TYPE, null).singleNodeValue; } console.log( getElementByXpath(“//html[1]/body[1]/div[1]”) ); <div>foo</div> https://gist.github.com/yckart/6351935 There’s also a great introduction on mozilla developer network: https://developer.mozilla.org/en-US/docs/Introduction_to_using_XPath_in_JavaScript#document.evaluate Alternative version, using XPathEvaluator: … Read more
This is caused by following 3 types: 1.The element is not visible to click. Use Actions or JavascriptExecutor for making it to click. By Actions: WebElement element = driver.findElement(By(“element_path”)); Actions actions = new Actions(driver); actions.moveToElement(element).click().perform(); By JavascriptExecutor: JavascriptExecutor jse = (JavascriptExecutor)driver; jse.executeScript(“scroll(250, 0)”); // if the element is on top. jse.executeScript(“scroll(0, 250)”); // if the … Read more
Java Yes, it is possible. The following example is in Java: WebDriver driver = new FirefoxDriver(); driver.get(“http://www.google.com/”); File scrFile = ((TakesScreenshot)driver).getScreenshotAs(OutputType.FILE); // Now you can do whatever you need to do with it, for example copy somewhere FileUtils.copyFile(scrFile, new File(“c:\\tmp\\screenshot.png”));
Basically, the way the Selenium detection works, is that they test for predefined JavaScript variables which appear when running with Selenium. The bot detection scripts usually look anything containing word “selenium” / “webdriver” in any of the variables (on window object), and also document variables called $cdc_ and $wdc_. Of course, all of this depends … Read more
selenium.common.exceptions.WebDriverException: Message: ‘geckodriver’ executable needs to be in PATH. First of all you will need to download latest executable geckodriver from here to run latest Firefox using Selenium Actually, the Selenium client bindings tries to locate the geckodriver executable from the system PATH. You will need to add the directory containing the executable to the … Read more
You can read the innerHTML attribute to get the source of the content of the element or outerHTML for the source with the current element. Python: element.get_attribute(‘innerHTML’) Java: elem.getAttribute(“innerHTML”); C#: element.GetAttribute(“innerHTML”); Ruby: element.attribute(“innerHTML”) JavaScript: element.getAttribute(‘innerHTML’); PHP: $element->getAttribute(‘innerHTML’); It was tested and worked with the ChromeDriver.