Question

4

Command-line argument issue

rated 0 times [ 4] [ 0] / answers: 1 / hits: 1277 / 2 Years ago, tue, april 12, 2022, 1:32:55

I have a bash script called test.sh and it current is:

url=

lynx -dump $url > story.txt

echo "step one completed"

Except when I run ./test.sh http://www.fox.com or any website, story.txt says:

                            Forbidden

   You don't have permission to access / on this server.

How do I fix it so that when I open story.txt, it displays the actual dump of the url?

Answers

Only authorized users can answer the question. Please sign in first, or register a free account.

asketbridiculou

Add To Favorites

Follow

Total Points: 168

Total Questions: 116

Total Answers: 115

Location: Antigua and Barbuda

Member since Sat, Jan 28, 2023

1 Year ago

asketbridiculou questions

1 Brightness issue ASUS Ubuntu 20.04

Thu, Dec 22, 22, 08:36, 1 Year ago

1 Enable/disable microphone in Terminal

Thu, Jan 27, 22, 14:28, 2 Years ago

1 How to install default 20.04 bgrt plymouth?

Tue, Nov 29, 22, 21:50, 1 Year ago

1 How to remove LibreOffice installed with Lubuntu 20.04

Sun, Jun 20, 21, 04:42, 3 Years ago

1 Unable to disable Desktop Icons extension

Sun, Aug 15, 21, 08:42, 3 Years ago

View All

answered 2 Years ago ditery · Accepted Answer

Your script does not work for me, but I guess it does for you so we might have a different setup. I changed the script to

lynx -dump $1 > story.txt

echo "step one completed"

I run it with

 ./test.sh http://www.techland.ro

and I get the same result.

Instead of running the script with fox.com try with techland.ro and you will see that the script actually works just fine. The problem is not with your script but with the website you are trying to access. I believe it blocks website crawlers, because lynx is a command line browser it actually acts exactly like a crawler, resulting in the message you get.

You can set different rules for websites, if a website blocks unknown crawlers then it will also probably block lynx (or any other command line browser). Your script is fine, the website is blocking you.